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Preface to the Third Edition 


The major changes to the third edition involve the exposition of the topological 
concepts required in the study of analysis. In the first two editions metric 
spaces are scattered throughout the text. For example, the Notes section of 
Chapter 3 contained the definitions of a metric space, e-neighborhoods, as 
well as open and compact sets. The Miscellaneous Exercises of this chapter 
also contained several relevant exercises. The concept of a metric and norm, 
as well as e-neighborhoods are also included in the Text in Section 7.4. 

In this third edition, I have decided to include the relevant topological 
concepts in Chapter 2, beginning with a discussion of metric spaces in Section 
2.1. The usual concepts of open and closed sets, as well as limit points of 
a set are included in Section 2.2. While the emphasis is on the general, the 
examples emphasize these topological concepts on the real line. Section 2.3 
contains a brief introduction to compact sets and their properties that require 
only the definition of compactness. Finally, the characterization of compact 
subsets of R is included in Section 2.4. Chapter 3 now contains all the topics 
previously included in Chapter 2, with the exception that the convergence 
of a sequence is defined in metric spaces. Likewise, limits of functions and 
continuity in Chapter 4 are also defined in metric spaces. Norms and normed 
linear spaces are still introduced in Chapter 7, with examples of the usual 
normed linear spaces in the remaining chapters. 

Even with these changes, the emphasis is still on sequences of real numbers, 
the compact subsets of R, as well as real-valued functions. The major theorems 
remain unchanged. The main advantages of the revision is that it unifies the 
subject matter, provides students with an introduction to metric spaces and 
abstract topological concepts, and provides a better preparation for advanced 
studies in analysis. 

The third edition also includes additional exercises and expanded hints 
and solutions. I have also attempted to correct some of the errors that were 
present in the earlier editions. The Supplemental Readings sections have also 
been updated. The one item that has been deleted is the appendix on Logic 
and Proofs previously included in the second edition. In the author’s opinion 
these are topics that are best covered in greater detail in a seperate course. 


Manfred Stoll 
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Preface to the First Edition 


The subject of real analysis is one of the fundamental areas of mathematics, 
and is the foundation for the study of many advanced topics, not only in 
mathematics, but also in engineering and the physical sciences. A thorough 
understanding of the concepts of real analysis has also become increasingly im- 
portant for the study of advanced topics in economics and the social sciences. 
Topics such as Fourier series, measure theory and integration, are fundamen- 
tal in mathematics and physics as well as engineering, economics, and many 
other areas. 

Due to the increased importance of real analysis in many diverse subject 
areas, the typical first semester course on this subject has a varied student 
enrollment in terms of both ability and motivation. From my own experience, 
the audience typically includes mathematics majors, for whom this course 
represents the only rigorous treatment of analysis in their collegiate career, 
and students who plan to pursue graduate study in mathematics. In addition, 
there are mathematics education majors who need a strong background in 
analysis in preparation for teaching high school calculus. Occasionally, the 
enrollment includes graduate students in economics, engineering, physics, and 
other areas, who need a thorough treatment of analysis in preparation for 
additional graduate study either in mathematics or their own subject area. 
In an ideal situation it would be desirable to offer separate courses for each 
of these categories of students. Unfortunately, staffing and enrollment usually 
make such choices impossible. 

In the preparation of the text there were several goals I had in mind. The 
first was to write a text suitable for a one-year sequence in real analysis at the 
junior or senior level, providing a rigorous and comprehensive treatment of the 
theoretical concepts of analysis. The topics chosen for inclusion are based on 
my experience in teaching graduate courses in mathematics, and reflect what 
I feel are minimal requirements for successful graduate study. I get to the least 
upper bound property as quickly as possible, and emphasize this important 
property in the text. For this reason, the algebraic properties of the rational 
and real number systems are treated very informally, and the construction 
of the real number system from the rational numbers is included only as 
a miscellaneous exercise. I have attempted to keep the proofs as concise as 
possible, and to let the subject matter progress in a natural manner. Topics or 
sections that are not specifically required in subsequent chapters are indicated 
by a footnote. 
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My second goal was to make the text understandable to the typical stu- 
dent enrolled in the course, taking into consideration the variations in abilities, 
background, and motivation. For this reason, chapters one through six have 
been written with the intent to be accessible to the average student, while at 
the same time challenging the more talented student through the exercises. 
The basic topological concepts of open, closed, and compact sets, as well as 
limits of sequences and functions are introduced for the real line only. However, 
the proofs of many of the theorems, especially those involving topological con- 
cepts, are presented in a manner that permit easy extensions to more abstract 
settings. These chapters also include a large number of examples and more 
routine and computational exercises. Chapters seven through ten assume that 
the students have achieved some level of expertise in the subject. In these 
chapters, function spaces are introduced and studied in greater detail. The 
theorems, examples, and exercises require greater sophistication and mathe- 
matical maturity for full understanding. From my own experiences, these are 
not unrealistic expectations. 

The book contains most of the standard topics one would expect to find 
in an introductory text on real analysis—limits of sequences, limits of func- 
tions, continuity, differentiation, integration, series, sequences and series of 
functions, and power series. These topics are basic to the study of real analy- 
sis and are included in most texts at this level. In addition I have also included 
a number of topics that are not always included in comparable texts. For in- 
stance, Chapter 6 contains a section on the Riemann-Stieltjes integral, and 
a section on numerical methods. Chapter 7 also includes a section on square 
summable sequences and a brief introduction to normed linear spaces. Both 
of these concepts appear again in later chapters of the text. 

In Chapter 8, to prove the Weierstrass approximation theorem, I use the 
method of approximate identities. This exposes the student to a very impor- 
tant technique in analysis that is used again in the chapter on Fourier series. 
The study of Fourier series, and the representation of functions in terms of 
series of orthogonal functions, has become increasingly important in many 
diverse areas. The inclusion of Fourier series in the text allows the student 
to gain some exposure to this important subject, without the necessity of 
taking a full semester course on partial differential equations. In the final 
chapter I have also included a detailed treatment of Lebesgue measure and 
the Lebesgue integral. The approach to measure theory follows the original 
method of Lebesgue, using inner and outer measure. This provides an intuitive 
and leisurely approach to this very important topic. 

The exercises at the end of each section are intended to reinforce the 
concepts of the section and to help the students gain experience in developing 
their own proofs. Although the text contains some routine and computational 
problems, many of the exercises are designed to make the students think about 
the basic concepts of analysis and to challenge their creativity and logical 
thinking. Solutions and hints to selected exercises are included at the end of 
the text. These problems are marked by an asterisk (*). 
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At the end of each chapter I have also included a section of notes on the 
chapter, miscellaneous exercises, and a supplemental reading list. The notes in 
many cases provide historical comments on the development of the subject, or 
discuss topics not included in the chapter. The miscellaneous exercises are in- 
tended to extend the subject matter of the text or to cover topics that although 
important, are not covered in the chapter itself. The supplemental reading list 
provides references to topics that relate to the subject under discussion. Some 
of the references provide historical information; others provide alternate solu- 
tions of results or interesting related problems. Most of the articles appear in 
the American Mathematical Monthly or Mathematics Magazine, and should 
easily be accessible for students’ reference. 

To cover all the chapters in a one-year sequence is perhaps overly ambi- 
tious. However, from my own experience in teaching the course, with a judi- 
cious choice of topics it is possible to cover most of the text in two semesters. 
A one-semester course should at a minimum include all or most of the first 
five chapters, and part or all of Chapter 6 or Chapter 7. The latter chapter 
can be taught independently of Chapter 6; the only dependence on Chapter 
6 is the integral test, and this can be covered without a theoretical treatment 
of Riemann integration. The remaining topics should be more than sufficient 
for a full second semester. The only formal prerequisites for reading the text 
is a standard three- or four-semester sequence in calculus. Even though an 
occasional talented student has completed one semester of this course during 
their sophomore year, some mathematical maturity is expected and the aver- 
age student might be advised to take the course during their junior or senior 
year. 


Manfred Stoll 


Taylor & Francis 
Taylor & Francis Group 


http://taylorandfrancis.com 


To the Student 


The difference between a course on calculus and a course on real analysis 
is analogous to the difference in the approach to the subject prior to the 
nineteenth century and since that time. Most of the topics in calculus were 
developed in the late seventeenth and eighteenth centuries by such promi- 
nent mathematicians as Newton, Leibniz, Bernoulli, Euler, and many others. 
Newton and Leibniz developed the differential and integral calculus; their suc- 
cessors extended and applied the theory to many problems in mathematics 
and the physical sciences. They had phenomenal insight into the problems, 
and were extremely proficient and ingenious in deriving complex formulas. 
What they lacked, however, were the tools to place the subject on a rigor- 
ous mathematical foundation. This did not occur until the nineteenth century 
with the contributions of Cauchy, Bolzano, Weierstrass, Cantor, and many 
others. 

In calculus the emphasis is primarily on developing expertise in compu- 
tational techniques and applications. In real analysis, you will be expected 
to understand the concepts and to develop the ability to prove results using 
the definitions and previous theorems. Understanding the concept of a limit, 
and proving results about limits, will be significantly more important than 
computing limits. To accomplish this, it is essential that all definitions and 
statements of theorems be learned precisely. Most of the proofs of the theo- 
rems and solutions of the problems are logical consequences of the definitions 
and previous results; some however do require ingenuity and creativity. 

The text contains numerous examples and counter-examples to illustrate 
the particular topics under discussion. These are included to show why certain 
hypotheses are required, and to help develop a more thorough understanding 
of the subject. It is crucial that you not only learn what is true, but that you 
also have sufficient counter-examples at your disposal. I have included hints 
and answers to selected exercises at the end of the text; these are indicated 
by an asterisk (*). For some of the problems I have provided complete details; 
for others I have provided brief hints, leaving the details to you. As always, 
you are encouraged to first attempt the exercises and, to look at the hints or 
solutions only after repeated attempts have been unsuccessful. 

At the end of each chapter I have included a supplemental reading list. 
The journal articles or books are all related to the topics in the chapter. 
Some provide historical information or extensions of the topics to more general 
settings; others provide alternate solutions of results in the text, or solutions 
of interesting related problems. All of the articles should be accessible in your 
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library. They are included to encourage you to develop the habit of looking 
into the mathematical literature. 

On reading the text you will inevitably encounter topics, formulas, or ex- 
amples that may appear too technical and difficult to comprehend. Skip them 
for the moment; there will be plenty for you to understand in what follows. 
Upon later reading the section, you may be surprised that it is not nearly as 
difficult as previously imagined. Concepts that initially appear difficult be- 
come clearer once you develop a greater understanding of the subject. It is 
important to keep in mind that many of the examples and topics that appear 
difficult to you were most likely just as difficult to the mathematicians of the 
era in which they first appeared. 

The material in the text is self-contained and independent of the calculus. 
I do not use any results from calculus in the definitions and development of 
the subject matter. Occasionally, however, in the examples and exercises, I do 
assume knowledge of the elementary functions and of notation and concepts 
that should have been encountered elsewhere. These concepts will be defined 
carefully at the appropriate place in the text. 


Manfred Stoll 
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1 
The Real Numbers 


The key to understanding many of the fundamental concepts of calculus, such 
as limits, continuity, and the integral, is the least upper bound property of the 
real number system R. As we all know, the rational number system contains 
gaps. For example, there does not exist a rational number r such that r? = 2, 
ie., V2 is irrational. The fact that the rational numbers do contain gaps makes 
them inadequate for any meaningful discussion of the above concepts. 

The standard argument used in proving that the equation r? = 2 does not 
have a solution in the rational numbers goes as follows: Suppose that there 
exists a rational number r such that r? = 2. Write r = @ where m,n are 
integers which are not both even. Thus m? = 2n?. Therefore m? is even, 
and hence m itself must be even. But then m?, and hence also 2n? are both 
divisible by 4. Therefore n? is even, and as a consequence n is also even. This 
however contradicts our assumption that not both m and n are even. The 
method of proof used in this example is proof by contradiction; namely, we 
assume the negation of the conclusion and arrive at a logical contradiction. 

The above argument shows that there does not exist a rational number 
r such that r? = 2. This argument was known to Pythagoras (around 500 
B.C.), and even the Greek mathematicians of this era noted that the straight 
line contains many more points than the rational numbers. It was not un- 
til the nineteenth century, however, when mathematicians became concerned 
with putting calculus on a firm mathematical footing, that the development 
of the real number system was accomplished. The construction of the real 
number system is attributed to Richard Dedekind (1831-1916) and Georg 
Cantor (1845-1917), both of whom published their results independently in 
1872. Dedekind’s aim was the construction of a number system, with the same 
completeness as the real line, using only the basic postulates of the integers 
and the principles of set theory. Instead of constructing the real numbers, we 
will assume their existence and examine the least upper bound property. As 
we will see, this property is the key to many basic facts about the real numbers 
which are usually taken for granted in the study of calculus. 

In Chapter 1 we will assume a basic understanding of the concept of a set 
and also of both the rational and real number systems. In Section 4 we will 
briefly review the algebraic and order properties of both the rational and real 
number systems and discuss the least upper bound property. By example we 
will show that this property fails for the rational numbers. In the subsequent 
two sections we will prove several elementary consequences of the least upper 
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bound property. In Section 7 we define the notion of a countable set, and 
consider some of the basic properties of countable sets. Among the key results 
of this section are that the rational numbers are countable, whereas the real 
numbers are not. 


1.1 Sets and Operations on Sets 


Sets are constantly encountered in mathematics. One speaks of sets of points, 
collections of real numbers, and families of functions. A set is conceived simply 
as a collection of definable objects. The words set, collection, and family 
are all synonymous. The notation x € A means that x is an element of the 
set A; the notation x ¢ A means that x is not an element of the set A. The 
set containing no elements is called the empty set and will be denoted by 9. 

A set can be described by listing its elements, usually within braces { }. 
For example, 

A = {-1, 2,5, 4} 

describes the set consisting of the numbers —1, 2, 4, and 5. More generally, 
a set A may be defined as the collection of all elements x in some larger 
collection satisfying a given property. Thus the notation 


A= {a: P(x)} 


defines A to be the set of all objects « having the property P(x). This is usually 
read as “A equals the set of all elements x such that P(x).” For example, if x 
ranges over all real numbers, the set A defined by 


A={a:l<a<5} 


is the set of all real numbers which lie between 1 and 5. For this example, 
3.75 € A whereas 5 ¢ A. We will also use the notation A = {x € X : P(x)} 
to indicate that only those x which are elements of X are being considered. 

Some basic sets that we will encounter throughout the text are the follow- 
ing: 


N = the set of natural numbers or positive integers = {1,2,3,....} 
Z = the set of allintegers = {...,—2,—1,0,1,2,...}, 

Q = the set of rational numbers = { p/q : p,qE Z, ¢# 0}, and 

R = the set of real numbers. 


In addition we will occasionally also encounter the set {0,1,2,3,...} of non- 
negative integers. 

Real numbers which are not rational numbers are called irrational num- 
bers. Since many fractions can represent the same rational number, two ratio- 
nal numbers 71 = pi/q, and rp = p2/q2 are equal if and only if qipo = piqa. 
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Set-theoretically the rational numbers can be defined as sets of ordered pairs 
of integers (m,n), n # 0, where two ordered pairs (p1,qi) and (p2,q2) are 
said to be equivalent (represent the same rational number) if pig2 = poq1. We 
assume that the reader is familiar with the algebraic operations of addition 
and multiplication of rational numbers. 

A set A is a subset of a set B or is contained in B, denoted A C B, if 
every element of A is an element of B. The set A is a proper subset of B, 
denoted A & B if A is a subset of B but there is an element of B which is not 
an element of A. Two sets A and B are equal, denoted A = B, if A C B and 
BCA. By definition, the empty set — is a subset of every set. 


Set Operations 


There are a number of elementary operations which may be performed on 
sets. If A and B are sets, the union of A and B, denoted AU B, is the set of 
all elements that belong either to A or to B or to both A and B. Symbolically, 


AUB ={«a: ce€Aor cEB}. 


The intersection of A and B, denoted AN B, is the set of elements that 
belong to both A and B; that is 


ANB={x: c€A and ce B}. 


Two sets A and B are disjoint if AN B = @. The relative complement 
B\ A, is the set of all elements which are in B but not in A. In set notation, 


B\A={«x:xc€B and w¢ A}. 


If the set A is a subset of some fixed set X, then X \ A is usually referred to 
as the complement of A and is denoted by A‘. These basic set operations 
are illustrated in Figure 1.1 with the shaded areas representing AU B, AN B, 
and B \ A, respectively. 


FIGURE 1.1 
AUB, ANB, B\ A 


There are several elementary set theoretic identities which will be encoun- 
tered on numerous instances throughout the text. We state some of these in 
the following theorem; others are given in the exercises. 
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THEOREM 1.1.1 /f A, B, and C are sets, then 
(a) AN(BUC) =(ANB)U(ANOC), 
(b) AU(BNC) =(AUB)N(AUC), 
(c) C\ (AUB) = (C\ A)N(C\ B), 
(d) C\ (ANB) = (C\ A)U(C\ B). 


The identities (a) and (b) are referred to as the distributive laws, 
whereas (c) and (d) are De Morgan’s laws. If A and B are subsets of a 
set X, then De Morgan’s laws can also be expressed as 


(AUB)°=A°N BY, = (AN B)° = ACU BY’. 


A more general version of both the distributive laws and De Morgan’s laws 
will be stated in Theorems 1.7.12 and 1.7.13. 


Proof. We will provide the proof of (a) to illustrate the method used in 
proving these results. The proofs of (b) — (d) are relegated to the exercises 
(Exercise 7). Suppose x € AN (BUC). Then x € A and « € BUC. Since 
zxé€BUC,x« € Borxe C.lf a € B, then « € ANB and therefore 
x € (AN B)U(ANC). Similarly, if z € C then « € ANC and thus again 
x € (AN B)U(ANC). This then proves that 


AN(BUC)c (ANB)U(ANC). 


To complete the proof, it still has to be shown that (AM B)U(ANC) Cc 
AN (BUC), thereby proving equality. If ¢ € (AN B) U(ANC), then by 
definition x € AN B or x € ANC, or both. But ifx Ee AN Bthenxe A 
and « € B. Since x € B we also have x € BUC. Therefore x € AN (BUC). 
Similarly, if ¢ ANC then «x € AN(BUC),. 


If A is any set, the set of all subsets of A is denoted by P(A). The set P(A) 
is sometimes referred to as the power set of A. For example, if A = {1,2}, 


then 
P(A) ~ {0, ths eae eveige 


In this example, the set A has 2 elements and P(A) has 4 or 2? elements, 
the elements in this instance being the subsets of A. If we take a set with 
3 elements, then by listing the subsets of A it is easily seen that there are 
exactly 2? subsets of A (Exercise 8). On the basis of these two examples we 
are inclined to conjecture that if A contains n elements, then P(A) contains 
2” elements. 


We now prove that this is indeed the case. We form subsets B of A by 
deciding for each element of A whether to include it in B, or to leave it out. 
Thus for each element of A there are exactly two possible choices. Since A has 
n elements, there are exactly 2” possible decisions, each decision corresponding 
to a subset of A. 


Finally, if A and B are two sets, the Cartesian product of A and B, 
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denoted A x B, is defined as the set of all ordered pairs!(a,b), where the 
first component a is from A and the second component b is from B, i-e., 


AxB = {(a,b) : a€ A, be Bh. 
For example, if A = {1,2} and B = {—1,2,4} then 
Ax B= {(1, =1), (A 2), (1,4), (2, =1); (2, 2), (2,4)}. 


The Cartesian product of R with R is usually denoted by R? and is referred 
to as the euclidean plane. If A and B are subsets of R, then A x B is a subset 
of R?. The case where A and B are intervals is illustrated in Figure 1.2. 


- AxB 


FIGURE 1.2 
The Cartesian product A x B 


Exercises 1.1 


1, Let A=j{—1,0/1,21,B ={—9,5); and O = {—2,0,1,5}. 
a. Find each of the following: (AU B), (BUC), (ANB), (BNC), 
AN(BUC), A\ B,C\ B, A\ (BUC). 
b. Find each of the following: (A x B), (C x B), (A x B)N(C x B), 
(ANC) x B. 


c. On the basis of your answer in (b), what might you conjecture about 
(ANC) x B for arbitrary sets A, B,C? 


1A set theoretic definition of ordered pair can be given as follows: (a,b) = {{a}, {a, b}}. 
With this definition two ordered pairs (a,b) and (c,d) are equal if and only if a = c and 
b = d (Miscellaneous Exercise 1). 
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2. Lett A={e@ER:-l<a<5}, B={et@eER:0<2< 3}, 
C={xeER:2<a< 4}. 
*a. Find each of the following: AN B, ANZ, BNC, AUB, BUC. 
*b. Find each of the following: A x B, Ax C, (Ax B)U(AxC). 
c. Sketch the sets (A x B)U(A x C) and A x (BUC). 
3. If A, B, and C are sets, prove that 
a. ANd=0, AUO=A, b.ANA=A, AUA=A, 
ce ANB=BNA, AUB=BUA. 
4. Prove the following associate laws for the set operations U and Mm: 
*a, AN(BNC)=(ANB)NC, b. AU(BUC) =(AUB)UC. 
5. If AC B, prove that 
a. ANB=A, b. AUB=B. 
6. If A is a subset of X, prove that 
a. AUAS=X, b. ANAS=9, c. (AT)S =A. 
7. If A, B, and C are sets, prove that 
*a, AU(BNC) = (AUB)N(AUC), b. C\(AUB) = (C\A)N(C\B), 
*c. C\ (ANB) =(C\A)U(C\B), d.(AUB)\C=(A\C)U(B\C). 
*Verify that a set with three elements has eight subsets. 


If A and B are subsets of a set X prove that 
a. A\B=ANB, 
b. AN B and A\ B are disjoint and that A= (AN B)U(A\ B). 


10. True or False. Either prove true for all sets A, B and C, or provide an 
example to show that the result is false. 


a. (AUB)\A=B. 
b. (AU B)\ (ANB) = (A\ B)U(B\ A). 
c. (AN B)U(BNC)U(ANC)=ANBNC. 
d. (AN B)\C=ANnN(B\C). 
11. *Prove that A x (Bi U Bz) = (A x Bi) U(A x Be). 
12. Suppose A, C are subsets of X and B, D are subsets of Y. Prove that 
(Ax B)A(C x D) = (ANC) x (BND). 


1.2 Functions 


We begin this section with the fundamental concept of a function. In many 
texts a function or a mapping f from a set A to a set B is described as a rule 
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Range f 


FIGURE 1.3 
A function as a graph 


that assigns to each element x € A a unique element y € B. This is generally 
expressed by writing y = f(x) to denote the value of the function f at 2. 
The difficulty with this “definition” is that the terms “rule” and “assigns” are 
vague and difficult to define. Consequently we will define “function” strictly 
in terms of sets, using the notation and concepts introduced in the preceding 
section. 

The motivation for the following definition is to think of the graph of a 
function; namely the set of ordered pairs (x,y) where y is given by the “rule” 
that defines the function. 


DEFINITION 1.2.1 Let A and B be any two sets. A function f from A 
into B is a subset of A x B with the property that each x € A is the first 
component of precisely one ordered pair (x,y) € f; that is, for everyx € A 
there exists y € B such that (x,y) € f, and if (x,y) and (a, y’) are elements 
of f, theny=y'. The set A is called the domain of f, denoted Dom f. The 
range of f, denoted Range f, is defined by 


Range f = {ye B: (x,y) € f for some x € A}. 
If Range f = B, then the function f is said to be onto B. (See Figure 1.3) 


If f is a function from A to B and (a,y) € f, then the element y is called 
the value of the function f at x and we write 


y=f(z) or fiary. 
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FIGURE 1.4 
A function as a mapping 


—-3-—+ 2 


—2— —2 
-i1— 4 
0— -6 
1— 4 


FIGURE 1.5 
The function of Example 1.2.2(a) 


We also use the notation f : A B to indicate that f is a function from (or 
on) A into (or to) B, and sometimes say that f maps A to B or is a mapping 
of A to B. If we think of a function f : A B as mapping an element x € A 
to an element y = f(x) in B, then this is often represented by a diagram as 
in Figure 1.4. If f : A R, then f is said to be a real-valued function on 
A. 

A function f from A to B is not just any subset of A x B. The key phrase 
in Definition 1.2.1 is that each x € A is the first component of precisely 
one ordered pair (x,y) € f. To better understand the notion of function we 
consider several examples. 


EXAMPLES 1.2.2 (a) Let A = {—3,—2,—1,0,1} and B = Z. Consider 
the subset f of A x B given by 


f= {( 3, 2), ( 2, 2), ( 1,4), (0, —6), (1, 4)}. 
Since each a € A belongs to precisely one ordered pair (x,y) € f, f isa 
function from A into B with Range f = {—6,—2,2,4}. Figure 1.5 indicates 
what f does to each element of A. Even though the element 4 in B is the 
second component of the two distinct ordered pairs (—1,4) and (1,4), this 
does not contradict the definition of function. 
(b) Let A and B be as in (a) and consider g defined by 


g = {(-3, 2), (2, 4), (-2, 1), (-1, 4), (0,5), (1, Df. 
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Since both (—2,4) and (—2, 1) are two elements of g with the same first com- 
ponent, g is not a function from A to B. 


(c) In this example, we let A = B =R, and let h be defined by 
h={(2,y) €RxR:y=2? 42}. 


This function is described by the equation y = 2? + 2. The standard way of 
expressing this function is as 


A(z) =2?+2, Domh=R. 


This specifies both the equation defining the function and the domain of the 
function. For this example, Rangeh = {y € R: y > 2}?. 


(d) Let A be any nonempty set and let 
i= {(x,2): a € A}. 


Then 7 is a function from A onto A whose value at each x € A is 2; ie., 
i(~) = x. The function 7 is called the identity function on A. 


(e) Let A and B be two nonempty sets and consider the projection 
function p from A x B to A defined by 


p = {((a,b),a) : (a,b) € A x B}. 


In this example, Dom p = A x B. Since p : (a,b) > a, we denote this simply 
by p(a,b) = a. For example, if A = {1,2,3} and B = {-1,1}, then A x 
B = {(1,-1), (1, 1), (2, -1), (2, 1), (3, —1), (3, 1)} and p(1,—-1) = 1, p(1,1) = 
1, p(2, —1) = 2, etc. 


As was indicated in (c) above, if our function h is given by an equation 
such as y = x” + 2 we will simply write h(x) = x? + 2, Domh = R, to denote 
the function h. It should be emphasized however that an equation such as 
h(x) = x? + 2 by itself does not define a function; the domain of h must also 
be specified. Thus 


h(z)=2?+2, Domh=R, 
and 
g(z)=27 +2, Domg={reR:-1<2 <2}, 


define two different functions. 


2Since a? > 0 for all « € R, the range of h is a subset of {y € R: y > 2}. To obtain 
equality, we require that for every y > 2 there exists an x € R such that x? + 2 = y. The 
existence of such a y will follow as a consequence of Example 1.4.6. 
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Image and Inverse Image 


DEFINITION 1.2.3 Let f be a function from A into B . If EC A, then 
f(E), the image of FE under f, is defined by 


f(E) = {f(x): a € E}. 
If H C B, the inverse image of H, denoted f~!(H), is defined by 
f(A) ={ee A: f(z) ] A}. 


If H contains a single element of B, i.e, H = fy}, we will write f—(y) 
instead of f—*({y}). Thus for y € B, 


fly) ={we A: f(x) =y}. 


It is important to keep in mind that for E Cc A, f(£) denotes a subset of 
B, while for H c B, f~'(H) describes a subset of the domain A. It should 
be clear that f(A) = Range f, and that f is onto B if and only if f(A) = B. 
To illustrate the notions of image and inverse image of a set we consider the 
following examples. 


EXAMPLES 1.2.4 (a) As in Example 1.2.2 let A = {—3,—2,-1,0,1}, 
B=Z, and f: A— Z the function given by 


f= {( 3, 2), ( 2, 2), ( 1,4), (0, —6), (1, 4)}. 
Consider the subset E = {—1,0,1} of A. Then 
FE) = {F(-1), FO), FO) = {-6, 4}. 
If H = {0,1,2,3,4}, then 


f-'(H) = {a © A: f(x) € H} = {—3,-1,1}. 

Since both f(—1) and f(1) are equal to 4, f~'(4) = {—1,1}. On the other 
hand, since (2,0) ¢ f for any x € A, f~!(0) =9. 

(b) Consider the function g : Z > Z given by g(x) = 2, and let E = 
$41 9 3 phen 

g(B) = {(—n)* sn € N} = {1,4,9,---}. 
On the other hand, 
g*(g(E)) = Z\ {0}. 

For this example E S g~'(g(£)). 

(c) Let h be the function defined by h(a) = 22 + 3, Domh = R. If EF = 
{fe R:-l<a< 2}, then 


A(B) = {244+3:-1l<a¢<2s={yeR:l<y< 7. 
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For the set E we also have 

h(E) ={x ER: 2r+3€ FE} ={x:-2<a<-}F}. 
For each y € R, x € h-+(y) if and only if 2x + 3 = y, which upon solving 


for x gives x = $(y — 3). Thus for each y € R, h7'(y) = {$(y — 3)}. Since 
h~*(y) 40 for each y € R, the function h maps R onto R. 


The operations of finding the image or inverse image of a set usually pre- 
serve the basic set operations of union and intersection. There is one important 
exception which is presented in part (b) of the next theorem. 


THEOREM 1.2.5 Let f be a function from A into B. If A, and Ag are 
subsets of A, then 

(a) f(A1U Az) = f(Ai) U f(A2), 

(b) f(A1N Az) C f(A1) N f(Az2). 


Proof. To prove (a), let y be an element of f(A;UA2). Then y = f(x) for some 
x in AyUAg. Thus « € A; or x € Ag. Suppose 2 € Ay. Then y = f(x) € f(A1). 
Similarly, if « € Ao, y € f(A2). Therefore y € f(A) U f(Ag). Thus 


f(ArU Az) C f(A1) U f(Ag). 


Since it is clear that f(A1) and f(A2) are subsets of f(A; U Az), the reverse 
inclusion also holds, thereby proving equality. 

Since f(A; M Ag) is a subset of both f(A1) and f(Ag), the relation stated 
in (b) is also true. 


To see that equality need not hold in (b), consider the function g(a) = 
x*, Domg = Z, of Example 1.2.4(b). If A; = {—1,—2,—3,---} and Ag = 
{1, 2, 3, ae }, then f(A) _ f(A2) = {1, 4,9, rece }, but Ay N Ag = 0. Thus 


f(Ai nN Az) = f() =0 = f(A1) al f(A2) = {1,4,9, aap 


THEOREM 1.2.6 Let f be a function from A to B. If By and Bz are subsets 
of B, then 
(a) f-'(BiU Ba) = f-* (Bi) 
(b) f-'(Bi NBs) = f-*(Br) 
(c) f-"(B\ Bi) = A\ f-*(Bi). 


Proof. The proof of Theorem 1.2.6 is left to the exercises (Exercise 8). 
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Inverse Function 


DEFINITION 1.2.7 A function f from A into B is said to be one-to-one 
if whenever x1 # X, then f(a) 4 f(x2). 


Alternately, a function f is one-to-one if whenever (1, y) and (a2, y) are 
elements of f then x; = x2. From the definition it follows that f is one-to-one 
if and only if f~(y) consists of at most one element of A for every y € B. 
If f is onto B, then f~'(y) 4 0 for every y € B. Thus if f is one-to-one and 
onto B, then f~!(y) consists of exactly one element 2 € A and 


g=ty,t) € Bx A: f(x) =y} 


defines a function from B to A. This leads to the following definition. 
DEFINITION 1.2.8 If f is a one-to-one function from A onto B, let 


f* ={(y,2) € Bx A: f(x) =y}- 


The function f~! from B onto A is called the inverse function of f. Fur- 
thermore, for each y € B, 


c=f'(y) ifand only if f(x) =y. 


There is a subtle point that needs to be clarified. If f is any function from 
A to B, then f~'(y) (technically f~'({y})) is defined for any y € B as the set 
of points x in A such that f(a) = y. However, if f is a one-to-one function of 
A onto B, then f~+(y) denotes the value of the inverse function f~! at y € B. 
Thus it makes sense to write f~'(y) = 2 whenever (y,x) € f~!. Also, if f is 
a one-to-one function of A into B, then f—! defined by 


f-" = {(y, x): y € Range f and f(x) = y} 


is a function from Range f onto A. 


FIGURE 1.6 
The inverse function 
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EXAMPLES 1.2.9 (a) Let h be the function of Example 1.2.4 (c); that is, 
h(a) = 2a + 3, Domh = R. The function h is clearly one-to-one and onto R 
with 

t=h"(y)=4(y—3), Domh=R. 


(b) Consider the function f defined by the equation y = x. If we take for 
the domain of f all of R, then f is not a one-to-one function. However, if we 
let 

Dom f=A={xER:ax> 0}, 


then f becomes a one-to-one mapping of A into A. To see that f is one-to- 
one, let 21, 22 € A with x; # xg. Suppose x < rg. Then 2? < 23, that is, 
f(x1) 4 f(x2). Therefore f is one-to-one. To show that f is onto A, we need 
to show that for each y € A, y > 0, there exists a positive real number x such 
that 

g? = y. 


Intuitively we know that such an z exists; namely the square root of y. How- 
ever, a rigorous proof of the existence of such an x will require the least upper 
bound property of the real numbers. In Example 1.4.6 we will prove that for 
each y > 0 there exists a unique positive real number x such that x? = y. 
The number z is called the square root of y and is denoted by \/y. Thus the 
inverse function of f is given by 


folly) = Vy, Dom f~! = {yER:y> 0}. 


Composition of Functions 


Suppose f is a function from A to B and g is a function from B to C. If 
x € A, then f(x) is an element of B, the domain of g. Consequently we can 
apply the function g to f(x) to obtain the element g(f(x)) in C. This process, 
illustrated in Figure 1.7, gives a new function h which maps x € A to g(f(x)) 
in C. 


DEFINITION 1.2.10 Jf f is a function from A to B and g is a function 
from B to C, then the function go f: AC defined by 


gof = {(t,2z)€AxC:z=g(f(a))} 
is called the composition of g with f. 


If f is a one-to-one function from A into B, then it can be shown that 
(f-1o f)(x) = = for all z € A and that (f o f~+)(y) = y for all y € Range f 
(Exercise 10). This is illustrated in (b) of the following example. 
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@ 


h(a) =8(f@) Cc 


FIGURE 1.7 
Composition of g with f 


EXAMPLES 1.2.11 (a) If f(z) = V1+<2 with Dom f ={z Ee R:2>-1} 
and g(x) = x7, Domg = R, then 


(go fw) = gl fla) = (VIFa)2 =14+2, Dom(go f) ={e eR: a> -1}. 


Even though the equation (go f)(a) = 1+2 is defined for all real numbers z, the 
domain of the composite function go f is still only the set {2 € R: a> -—-1}. 
For this example, since Range g C Dom f, we can also find f o g; namely, 


(f og)(x) = f(g(x)) = V1+2?, Dom fog=R. 


(b) For the function f in (a), the inverse function f~' is given by 


f"'(y)=y-1, Dom f~* = Range f = {y ER: y > 0}. 
Thus for « € Dom f, 

(f-*o f\@) =f" F@) = ¢@)? -1=Wet1P? -1=2, 
and for y > 0, 


(fof) = fF") = Vy? -Y+1=y. 


Exercises 1.2 


1. Let A = {—1,0,1,2} and B =N. Which of the following subsets of A x B 
is a function from A into B. 


a. f = {(—1,2), (0,3), (2,5)} 
*b. g = {(-1, 2), (0,7), 1, -1), (1, 3), (2, 7) 
c. h = {(-1, 2), (0, 2), (1, 2), (2,-1)} 
*dk={((,y): y = 2"+3,2€ A} 


The Real Numbers 15 


2: 


10. 


11. 


*a. Let A = {(2,y) C RXR: 2? +y? = 1}. Is A a function? Explain 
your answer. 


b. Let B = {(2,y) ERXR: a2? +y? = 1, y > O}. If B a function? 
Explain your answer. 


Let f : NN be the function defined by f(n) = 2n — 1. Find f(£) and 
f—'(B) for each of the following subsets EF of N. 


*a. {1,2,3,4} b. {1,3,5,7} oc. N 

Let f ={(a,y): 2 ER, y=o2?4+ 1}. 

*a. Let A= {x : —1 <a < 2}. Find f(A) and f7'(A). 
b. Show that f is a one-to-one function of R onto R. 

*c, Find the inverse function f~?. 

Let f, g mapping Z into Z be given by f(x) = x+3 and g(x) = 22. 
a. Find (f 0 g)(x) and (go f)(z). 

*b. Find (f 0 g)(N) and (go f)(N). 


For each of the following real-valued functions, find the range of the 
function f and determine whether f is one-to-one. If f is one-to-one, find 
the inverse function f~' and specify the domain of f~?. 


a. f(n) =5a+4+4, Dom f =R. 
*b. f(x) = 3x —- 2, Dom f =R. 
Dom f={t#ER:0<2< l}. 


d. f(x) = sing, Dom f={tER:0<a< 7}. 
*e. f(x,y) =2, Dom f = R?. 
*f. f(x) = ead’ 
g. f={(a,27):0<a< 1}. 


Let A= {t €R:0<t < 27} and B =R?’, and let f : A> B be defined 
by f(t) = (cost, sint). 


*a. What is the range of f? 

*b. Find f~! of each of the following points: (1,0), (0,—1), (2, ay, (0, 1). 
c. Is the function f one-to-one? 

Prove Theorem 1.2.6. 

Let f: A> Band let FCA. 

a. Prove that f(A) \ f(F) Cc f(A\ F). 

b. Give an example for which f(A) \ f(F) 4 f(A\ F). 


a. If f is a one-to-one function from A into B. Show that (f~'of)(«) =a 
for all 2 € A and that (f o f~')(y) = y for all y € Range f. 


b. If g is a function from C into A and h = f og, show that g = f~toh. 


*Let f: A> Band g: B- A be functions satisfying (go f)(x) = x for 
all « € A. Show that f is a one-to-one function. Must f be onto B? 


Dom f = {rE R:-1<a<l}. 
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12. If f: A Bandg: B — C are one-to-one functions, show that 
(go f)* = f-* og™ on Range (90 f). 


1.3. Mathematical Induction 


Throughout the text we will on occasion need to prove a statement, identity, 
or inequality involving the positive integer n. As an example, consider the 
following identity. For each n € N, 
port 
port pe.ep? = ——__., rl. 
Sf 

Mathematical induction is a very useful tool in establishing that such an 
identity is valid for all positive integers n. 


THEOREM 1.3.1 (Principle of Mathematical Induction) For each 
nE€N, let P(n) be a statement about the positive integer n. If 


(a)  P(1) is true, and 
(b) P(k+1) is true whenever P(k) is true, 
then P(n) is true for alln EN. 


The proof of this theorem depends on the fact that the positive integers 
are well-ordered; namely, every nonempty subset of N has a smallest ele- 
ment. This statement is usually taken as a postulate or axiom for the positive 
integers: we do so in this text. Since it will be used on several other occasions, 
we state it both for completeness and emphasis. 


WELL-ORDERING PRINCIPLE Every nonempty subset of N has a 
smallest element. 


The well-ordering principle can be restated as follows: If A Cc N, A # 9, 
then there exists n € A such that n < k for all k € A. 


To prove Theorem 1.3.1 we will use the method of proof by contradiction. 
Most theorems involve showing that a statement P implies the statement Q; 
namely, if P is true, then Q is true. In a proof by contradiction one assumes 
that P is true and Q is false, and then shows that these two assumptions lead 
to a logical contradiction; namely show that some statement R is both true 
and false. 


Proof of Theorem 1.3.1 Assume that the hypothesis of Theorem 1.3.1 are 
true, but that the conclusion is false; that is, there exists a positive integer n 
such that the statement P(n) is false. Let 


A={kEN: P(k) is false }. 
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By our assumption the set A is nonempty. Thus by the well-ordering principle 
A has a smallest element k,. Since P(1) is true, k, > 1. Also, since k, is the 
smallest element of A, P(k. — 1) is true. But then by hypothesis (b), P(ko) 
is also true, which is a contradiction. Consequently, P(n) must be true for all 
neN. 


EXAMPLES 1.3.2 We now provide two examples to illustrate the method 
of proof by mathematical induction. The first example provides a proof of the 
identity in the introduction to the section. An alternate method of proof will 
be requested in the exercises (Exercise 7). 


(a) To use mathematical induction, we let our statement P(n), n € N, be 
as follows: 
rant 
restr? = ——__., rl. 
l-r 


When n = 1 we have 
WLS), oS r2 


r= ir) oe provided rl. 


Thus the identity is valid for n = 1. Assume P(k) is true for k > 1, ie., 


k+1 
r—T 
rte trea ‘ rAl. 
1l-r 


We must now show that the statement P(k + 1) is true; that is 


a i eS rl. 
But 
poe pr htt apy ee eh pp htt 
which by the induction hypothesis 
SP th ee Ors 
Lay l—-r 
a es rA#l. 


Thus the identity is valid for k+1, and hence by the principle of mathematical 
induction for alln € N. 


(b) For our second example we use mathematical induction to prove 
Bernoulli’s inequality. If h > —1, then 


(1+h)" >1+nh for alln EN. 
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When n = 1, (1+h)! = 1+h. Thus since equality holds, the inequality is 
certainly valid. Assume that the inequality is true when n = k, k > 1. Then 
forn=k+1, 


(L+h)**t = (1+h)*(1 +h), 
which by the induction hypothesis and the fact that (1 +h) > 0 


>(1+kKA)\1 +h) =14+(kK+1)A+kh? 
>1+(k+1)h. 


Therefore the inequality holds for n = k +1, and thus by the principle of 
mathematical induction for all n € N. 


Although the statement of Theorem 1.3.1 starts with n = 1, the result is 
still true if we start with any integer no € Z. The modified principle of 
mathematical induction is as follows: If for each n € Z,n > 1n,, P(n) isa 
statement about the integer n satisfying 


(a’)  P(n,) is true, and 
(b’) P(k+1) is true whenever P(k) is true, k > no, 
then P(n) is true for alln € Z, n> no. 


The proof of this follows from Theorem 1.3.1 by simply setting 
Q(n) = P(n+n,— 1), neéeN, 


which is now a statement about the positive integer n. 


Remark. In the principle of mathematical induction, the hypothesis that 
P(1) be true is essential. For example, consider the statement P(n): 


n+l=n, neN. 


This is clearly false! However, if we assume that P(k) is true, then we also 
obtain that P(&+1) is true. Thus it is absolutely essential that P(n,) be true 
for at least one fixed value of no. 


There is a second version of the principle of mathematical induction which 
is also quite useful. 


THEOREM 1.3.3 (Second Principle of Mathematical Induction) 
For eachn €N, let P(n) be a statement about the positive integer n. If 


(a) P(1) is true, and 

(b) fork > 1, P(k) ts true whenever P(j) is true for all positive integers 
j<hk, 
then P(n) is true for alln EN. 
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Proof. (Exercise 3). 


Mathematical induction is also used in the recursive definition of func- 
tions defined for the positive integers. In this procedure, we give an initial 
value of the function f at n = 1, and then assuming that f has been defined 
for all integers k = 1,...,n, the value of f at n+ 1 is given in terms of the 
values of f at k, k <n. This is illustrated by the following examples. 
EXAMPLES 1.3.4 (a) As an example, consider the function f : N ~ N 
defined by f(1) = 1 and f(n+1) = nf(n),n € N. The values of f for 
n = 1,2,3,4 are given as follows: 


Ff) =1, F(2) =1, (3) = 2f(2) = 2-1, F(4) = 8f(3) = 3-2-1. 
Thus we conjecture that f(n) = (n — 1)!, where 0! is defined to be equal to 
one, and for n € N, n! (read n factorial) is defined as 
nl=n-(n—1)---2-1. 


This conjecture is certainly true when n = 1. Thus assume that it is true for 
n=k,k> 1, that is f(k) = (k-1)!. Then forn=k+1, 


f(k +1) = kf(k) 
which by the induction hypothesis 
=k-(k-1l=hl. 
Therefore the identity holds for n = (kK + 1), and thus by the principle of 


mathematical induction for all n € N. 


(b) For our second example, consider the function f : N > R defined by 
f(1) =0, f(2) = §, and for n > 3 by f(n) = (af (n — 2), Computing the 
values of f for n = 3,4,5, and 6, we have 

1 
F(3)=0, FA)=—, F(5)=0, F(6)= 


From these values we conjecture that 


0, if n is odd, 
f(n) = 


if n is even. 


n+l’ 
To prove our conjecture we will use the second principle of mathematical 
induction. Our conjecture is certainly true for n = 1,2. Suppose n > 2, and 
suppose our conjecture holds for all k < n. If n is odd, then so is (n — 2), 
and thus by the induction hypothesis f(n — 2) = 0. Therefore f(n) = 0. On 
the other hand if n is even, so is (n — 2). Thus by the induction hypothesis 
f(n — 2) =1/(n — 1). Therefore 


sen) = (255) in—) = (255) So = 
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Exercises 1.3 


1. 


Use mathematical induction to prove that each of the following identities 
are valid for alln EN. 


a.1+2+34 = Mery) 
*b.14+345+---+(2n-1) =n’. 

a P42 pe. pn? = BOtDOn +I) 
*d. 1°42? 4+---4+n? = [En(n4 iy]? 


e. 2427422 +--.4+2" = 2(2”— 1). 
*f, Fora,y@€R, a th—y™tt = (2-—y)(a® +arlyt--- ty”). 
1 1 1 _ on 

SQ) 2G) ) nad) nae 
Use mathematical induction to establish the following inequalities for 
neN. 

*a, 2” >n for alln EN b. 2" > n? for alln >5 

*e. n! > 2” for alln > 4 *q 18428 4..-4n2 < zn4 for alln > 3 


Prove Theorem 1.3.3. 


*Let f : N — N be defined by f(1) = 5, f(2) = 13, and for n > 3, 
f(n) = 2f(n — 2) + f(n— 1). Prove that f(n) = 3-2" + (—1)” for all 
neN. 

For each of the following functions with domain N, determine a formula 
for f(n) and use mathematical induction to prove your conclusion. 


a. f(1) =}, and forn > 1, f(n) =(n—Df(n—1) a. 
*b, (0) = 1; (2) 4, aad EAS 2, fm) SOF —1)— fr 2) 42 
KK shan ON = meV in Lp: 
*d. f(1) =1, f(2) =0, and for n> 2, f(n) = a cert 
e Hob dices eR arbinaries FO) =i. FO) Say ond Hen SD 
s(n) =~. 


*f, For a1, a2 € R arbitrary, let f(1) = ai, f(2) = ae, and for n > 2, 
mal 

= — 2). 
s(n) = (252) re) 
Let f : NN be defined by f(1) = 1, f(2) = 2, and 

1 

F(n +2) = 5(F(n +1) + f(n)). 
Use Theorem 1.3.3 to prove that 1 < f(n) < 2 for alln EN. 
r—rrtt 


*Prove that r+r?7+---+9r" = i ,r#1,n EN, without using 
—rT 


mathematical induction. 
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8. *Use mathematical induction to prove the arithmetic-geometric 
mean inequality: If ai, a2,...,an, n € N, are nonnegative real numbers, 
then 

(tase) 
a1a2°+'An < ; 
n 
with equality if and only if ay = ag =--- = an. 
a 


1.4 The Least Upper Bound Property 


In this section, we will consider the concept 
set and introduce the least upper bound or 


of the least upper bound of a 
supremum property of the real 


numbers R. Prior to introducing these new ideas we briefly review the algebraic 


and order properties of Q and R. 


Both the rational numbers Q and the real numbers R are algebraic systems 


known as fields. The key facts about a field 
it is a set F with two operations, addition (- 
satisfy the following axioms: 


Ifa,be F, thena+beFanda-beF. 


which we need to know is that 
+) and multiplication (-), which 


= 


2. The operations are commutative; that is, for all a,b € F 


a+b=b+a and 


3. The operations are associative; that 


a+(b+c)=(a+6)+c and 


a-b=b-a. 


is, for all a,b,c € F, 


a:(b-c)=(a-b)-c. 


There exists an element 0 € F such that a+0 =a for every a € F. 


5. Every a € F has an additive inverse; that is, there exists an element 


—a in F such that 


a + (-a) = 0. 


6. There exists an element 1 € F with 1 40 such that a-1 =a for all 


ack. 


7. Every a € F with a 4 0 has a multiplicative inverse; that is, there 


exists an element a~! in F such that 


8. The operation of multiplication is distributive over addition; that 


is, for all a,b,c € F, 


a-(b+ c) =a-b+a-e. 
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The element 0 is called the zero of F and the element 1 is called the unit 
of F. For a 4 0, the element a7! is customarily written as 4 or 1/a. Similarly 
we write a — b instead of a + (—b), ab instead of a:b, and a/b or $ instead of 


ab", 

The real numbers R contain a subset P known as the positive real num- 
bers satisfying the following: 

(O1) Ifa,beP, thna+be€Panda-beP. 

(O2) If a € R then one and only one of the following hold: 


aceP, -aeEP, a=0. 


Properties (O1) and (O2) are called the order properties of R. Any field F 
with a nonempty subset satisfying (O1) and (O02) above is called an ordered 
field. For the real numbers we assume the existence of a positive set P. For 
the rational numbers Q, the set of positive rational numbers is given by 
PN Q which can be proved to be equal to { p/q: p,q€ Z, ¢ #0, pq € N}. 

Let a,b be elements of R. If a — b is positive, i.e., a—b € P, then we write 
a > bor b<a. In particular, the notation a > 0 (or 0 < a) means that a is a 
positive element. Also, a < b (or b> a) ifa<bora=b. 

The following useful results are immediate consequences of the order prop- 
erties and the axioms for addition and multiplication. Let a,b,c be elements 
of R. 

(a) Ifa>b, thena+c>b+e. 

(b) If a> b and c > 0, then ac > be. 

(c) Ifa > b and c < 0, then ac < be. 

(d) If a £0, then a? > 0. 

(e) Ifa > 0, then 1/a > 0; if a < 0, then 1/a < 0. 

To illustrate the method of proof, we provide the proof of (b). Suppose a > b; 
i.e, a — b is positive. If c is positive, then by (O1) (a — b)c is positive. By the 
distributive law, 

(a — b)c = ac — be. 


Therefore ac — bc is positive; that is, ac > bc. The proofs of the other results 
are left as exercises. 


Upper Bound of a Set 


We now turn our attention to the most important topic of this chapter; namely, 
the least upper bound or supremum property of R. In Example 1.4.2(c) we 
will show that this property fails for the rational numbers Q. First however, 
we define the concept of an upper bound of a set. 


DEFINITION 1.4.1 A subset E of R is bounded above if there exists 
BER such that « < 6 for every x € E. Such a 6 is called an upper bound 
of E. 
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The concepts bounded below and lower bound are defined similarly. 
A set E is bounded if E is bounded both above and below. We now consider 
several examples to illustrate these concepts. 
EXAMPLES 1.4.2 (a) Let A = {0,5,3,3,..} = {1-4:7 =1,2,3,...} 
Clearly A is bounded below by any real number r < 0 and also above by any 
real number s > 1. 


(b) N = {1,2,3,...}. This set is bounded below; e.g., 1 is a lower bound. 
Our intuition tells us that N is not bounded above. It is obvious that there 
is no positive integer n such that 7 < n for all 7 € N. However, what is not 
so obvious is that there is no real number / such that 7 < ( for all 7 € N. In 
fact, given 6 € R, the proof of the existence of a positive integer n > ( will 
require the least upper bound property of R (Theorem 1.5.1). 

(c) B={r€Q:r>O0andr? < 2}. Again it is clear that 0 is a lower 
bound for B, and that B is bounded above; e.g., 2 is an upper bound for B. 
What is not so obvious however is that B has no maximum. By the maximum 
or largest element of B we mean an element a € B such that p < a for all 
p € B. Suppose p € B. Define the rational number q by 


With q as defined, a simple computation gives 


2 _ 2p? — 2) 
ao) 


Since p? < 2, q > p and q? < 2. Thus B has no largest element. Similarly, the 
set 
{p€Q:p>0, p? > 2} 


has no minimum or smallest element. Intuitively, the largest element of B 
would satisfy p? = 2. However, as was shown in the introduction, there is no 
rational number p for which p? = 2. 


Least Upper Bound of a Set 


DEFINITION 1.4.3 Let EF be a nonempty subset of R that is bounded above. 
An element a € R is called the least upper bound or supremum of E if 
(i) @ ts an upper bound of E, and 
(ii) if GER satisfies B <a, then B is not an upper bound of E. 


Condition (ii) is equivalent to w < 6 for all upper bounds 6 of E. Also by 
(ii), the least upper bound of a set is unique. If the set EF has a least upper 
bound, we write 

a=sup Ff 
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to denote that a is the supremum or least upper bound of F. The greatest 
lower bound or infimum of a nonempty set F is defined similarly, and if it 
exists, is denoted by inf E. 

There is one important fact about the supremum of a set which will be 
used repeatedly throughout the text. Due to its importance we state it as a 
theorem. 


THEOREM 1.4.4 Let A be a nonempty subset of R that is bounded above. 
An upper bound a of A is the supremum of A if and only if for every B < a, 
there exists an element x € A such that 


B<a<a 


Proof. Suppose a = sup A. If 8 < a, then @ is not an upper bound of A. 
Thus there exists an element x in A such that x > 6. On the other hand, since 
q@ is an upper bound of A, x <a. 


Conversely, if a is an upper bound of A satisfying the stated condition, 
then every 8 < q@ is not an upper bound of A. Thus a = sup A. 


EXAMPLES 1.4.5 In the following examples, let’s consider again the three 
sets of the previous examples. 


(a) As in Example 1.4.2(a), let A = {0,5, 3,3,---}. Since 0 is a lower 
bound of A and 0 € A, inf A = 0. We now prove that sup A = 1. Since 
1- + <1 for alln = 1,2,..., 1 is an upper bound. To show that 1 = sup A 
we need to show that if 8 € R with 6 < 1, then @ is not an upper bound of 
A. Clearly if 6 < 0, then is not an upper bound of A. Suppose as in Figure 
1.8,0< 6 <1. Then our intuition tells us that there exists an integer n, such 
that 

No > 


1 
1-£ hs. 


FIGURE 1.8 
Proof that sup A = 1 in Example 1.4.5(a) 
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But 1— — € A, and thus £ is not an upper bound. Therefore sup A = 1. 
The existence of such an integer n, will follow from Theorem 1.5.1. In this 
example, inf A € A but supA ¢ A. 


(b) For the set N, inf N = 1. Since N is not bounded above, N does not 
have an upper bound in R. 


(c) In this example, we prove that the supremum of the set 
B={reQ:r>0 and r’ <2}, 


if it exists, is not an element of Q. Suppose a = sup B exists and is in Q. 
Since a is rational, a? # 2. Thus a? < 2 or a? > 2. But if a € B, then 
since B contains no largest element, there exists q € B such that gq > a. This 
contradicts that a is an upper bound of B. Similarly, if a? > 2, then there 
exists a gq < a such that gq? > 2. But then q is an upper bound of B, which is 
a contradiction of property (ii) of Definition 1.4.3. The least upper bound of 
B in R is V2 (Section 1.5, Exercise 9), which we know is not rational. 


Least Upper Bound Property of R 


The following property, also referred to as the completeness property of 
R, distinguishes the real numbers from the rational numbers and forms the 
foundation for many of the results in real analysis. 


SUPREMUM OR LEAST UPPER BOUND PROPERTY OF R 
Every nonempty subset of R that is bounded above has a supremum in R. 


For our later convenience we restate the supremum property of R as the 
infimum property of R. 


INFIMUM OR GREATEST LOWER BOUND PROPERTY OF R. 
Every nonempty subset of R that is bounded below has an infimum in R. 


Although stated here as a property, which we will assume as a basic axiom 
about R, the least upper bound property of R is really a theorem due to both 
Cantor and Dedekind, both of whom published their results independently in 
1872. Dedekind, in the paper “Stetigkeit und irrationale Zahlen” (Continuity 
and irrational numbers), used algebraic techniques now known as the method 
of Dedekind cuts to construct the real number system R from the rational 
numbers Q. He proved that the system R contained a natural subset of positive 
elements satisfying the order axioms (Ol) and (O02), and furthermore, that 
R also satisfied the least upper bound property. The books by Burrill and 
by Spooner and Mentzger cited in the Supplemental Readings are devoted 
to number systems. Both texts contain Dedekind’s construction of R. Cantor 
on the other hand constructed R from Q using Cauchy sequences. In the 
miscellaneous exercises of Chapter 3 we will provide some of the key steps of 
this construction. 
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EXAMPLE 1.4.6 In this example, we show that for every positive real num- 
ber y > 0, there exists a unique positive real number a such that a? = y; ie., 
a= ,/y. The uniqueness of a was established in Example 1.2.9(b). 


We only prove the result for y > 1, leaving the case 0 < y < 1 to the 
exercises (Exercise 6). Let 


C={xER:2>0and 2? < y}. 


With y = 2, this set is similar to the set B of Example 1.4.5(c), except 
that here we consider all positive real numbers x for which x? < y. Since 
y > 1,1 €C and thus C is nonempty. Also since y > 1, y? > y, and thus y 
is an upper bound of C’. Hence by the least upper bound property, C’ has a 
supremum in R. Let a = supC. We now prove that a? = y. To accomplish 
this we show that the assumptions a? < y and a? > y lead to contradictions. 


Thus a? = y. 
Define the real number 8 by 
2 
— 1 
p=o+(! =) - vee ) (1) 
at+y at+y 
Then | (a2 
2 yly— Il(at—y 
= ia 2 


If a? < y, then by (1) 8 > a, and by (2) 6? < y. This contradicts that a is an 
upper bound for C. On the other hand, if a? > y, then by (1) 6 < a and by 
(2), 6? > y. Thus if x € R with x > 8, then x? > y. Therefore @ is an upper 
bound of C. This contradicts that a@ is the least upper bound of C. Since 6 
defined by (1) may not be rational, the same proof will not work for the set B 
of Example 1.4.5(c). However, using Theorem 1.5.2 of the following section, it 
is possible to also prove that sup B = V2. 


For convenience, we extend the definition of supremum and infimum of a 
subset E of R to include the case where F is not necessarily bounded above 
or below. 


DEFINITION 1.4.7 If E is a nonempty subset of R, we set 


supL = o if E is not bounded above, and 
inf E =—oo if E is not bounded below. 


For the empty set 0, every element of R is an upper bound of @ . For 
this reason the supremum of the empty set @ is taken to be —oo. Similarly, 
inf @ = oo. Also, for the symbols —oo and co we adopt the convention that 
—co <a“ <o for every cE R. 
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Intervals 


Using the order properties of R, we can define certain subsets of R known as 
intervals. 


DEFINITION 1.4.8 For a,b € R, a < b, the open interval (a,b) is de- 
fined as 
(a,b) ={w@ ER:a<au< bd}, 


whereas the closed interval [a,b] is defined as 
[a,b] = {x ER: a<a< bd}. 
In addition, we also have the half-open (half-closed) intervals 


[a,b) ={x# €R:a<-2< }d}, 
(a,b] = {x ER:a<a< bd}, 


and the infinite intervals 


(a,oo) = {aE R:a<a< oo}, 
[a,co) = {a ER: a<ax< oo}, 


with analogous definitions for (—oo, b) and (—o0, b]. The intervals (a, oo), (—o0, b) 
and (—oo, co) = R are also referred to as open intervals, whereas the intervals 
[a, co) and (—o0, b] are called closed intervals. 


In the above, when b = a, (a,a) = 9 and [a, a] = {a}. Although the empty 
set ( and the singleton {a} do not fit our intuitive definition of an interval, 
we will include them as the degenerate case of open and closed intervals re- 
spectively. It should be noted that the intervals of the form (a, b), (a, bj, [a, b), 
and [a,b] with a, b € R, a < b, are all bounded subsets of R. 


An alternate way of defining intervals without use of the adjectives open 
and closed is as follows: 


DEFINITION 1.4.9 A subset J of R is an interval if whenever x,y € J 
with « <y, then every t satisfyingx <t<y isin J. 


This definition also allows the possibility that J is empty or a singleton. 
One can show that that every set J satisfying the above is one of the intervals 
defined in Definition 1.4.8 (Exercise 21). 
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Exercises 1.4 


1. 


12. 


13. 


Use the axioms for addition and multiplication to prove the following: if 
a €R, then 


a.a-0=0. b. (-1)-a=-a. c. —(-a) =a. 

Let a,b € R. Prove the following: 

a. Ifa #0, then 4 #0. b.Ifa-b=0, then either a=0 or b=0. 
Let a,b,c € R. Prove the following: 

a.Ifa>b,thena+c>b+c. b.Ifa¥0, then a? > 0. 

c. Ifa >bandc> 0, then ac > be. 

d. If a > 0 then 1/a > 0, and if a < 0 then 1/a < 0. 

*If a,b € R, prove that ab < $(a? +07). 


Find the supremum and the infimum of each of the following sets: 
1 
*a, A= {1, 3, + * sch= {ser nent 
b. B= {cosn3 :n€ N} 
¥e. C = {(1- (-1)")” :n EN} 
d. D = {sinn$;n € N} 


e. FE = {ncosnr:neEN 
“P= {?*" nenh 

n 
g.G={(-1)"— 5: n EN} 
*h. H={xER: 2? < 4}. 
iP af{e? v2 <a <2) 


If 0 < y < 1, prove that there exists a unique positive real number x such 
that «? = y. 


Prove that there exists a positive real number x such that x? = 2. 


*Let A be a nonempty subset of R. If a = sup A is finite, show that for 
each € > 0, there is an a € A such that a—e<a<a. 


Let E be a nonempty subset of R that is bounded above, and set U = 
{@ © R: 8 is an upper bound of EF}. Prove that sup E = inf U. 


Let A be a nonempty subset of R and let —A = {—x : x € A}. Prove 
that inf A = — sup(—A). 

If A and B are nonempty subsets of R with A C B, prove that 

inf B <inf A < supA < sup B. 

Suppose that A and B are bounded subsets of R. Prove that AU B is 
bounded and that sup(A U B) = sup{sup A, sup B}. 


Use the least upper bound property of R to prove that every nonempty 
subset of R that is bounded below has an infimum. 
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14. 


15. 


16. 


17. 


18. 


19. 


20. 


For A, B subsets of R, define 
A+B={a+b:a€A,be€B} and A-B={ab:ac A, bE Bh. 


a. For A = {—1,2,4,7} and B = {—2,-—1,1}, find A+ B and A: B. 


*b. If A and B are nonempty and bounded above, prove that 
sup(A + B) = supA + sup B. 


c. If A and B are nonempty subsets of the positive real numbers that 
are bounded above, prove that sup(A- B) = (sup A)(sup B). 


d. Give an example of two nonempty bounded sets A and B for which 
sup(A - B) ¥ (sup A)(sup B). 
Let f, g be real-valued functions defined on a nonempty set X satisfy- 
ing Range f and Rangeg are bounded subsets of R. Prove each of the 
following: 
*a. sup{ f(x) + g(a): a € X} < sup{f(x): 2 € X}+sup{g(x): a € X}. 
b. Provide an example for which equality does not hold in (a). 
ce. inf{ f(x): a € X}+inf{g(x): a © X} < inf{f(x) + g(x): a € X}. 
*d. If f(x) < g(a) for all « € X, then sup{f(x) :  € X} < sup{g(z) : 
xe X}. 
e. For each x € X, let h(x) = max{ f(x), g(x)}. Prove that 
sup{h(a) : a2 € X} = max{sup{f(z): a € X},sup{g(x): a © X}}. 
Let X = Y = [0,1] and let f : X x Y — R be defined by f(z, y) = 3a4+2y. 
*a. For each x € X, find F(x) = sup{f(x,y) : y € Y}; then find 
sup{ F(x): a € X}. 
b. For each y € Y, find G(y) = sup{ f(x,y) :  € X}; then find 
sup{G(y) :y € Y}. 
*c. Find sup{ f(x,y) : (z,y) € X x Y}. Compare your answer with your 
answer in parts (a) and (b). 
Perform the computations of Exercise 16 with X = [—1,1] , Y = [0,2], 
and f(x,y) = 3x — 2y. 
Let X, Y be nonempty sets, and let f be a nonnegative real-valued func- 
tion defined on X x Y. For each « € X and y € Y, define 
F(a) =sup{f(x,y):yeY}, Gly) = supt{f(w,y): © € X}. 
Prove that 
sup{ F(x) :¢ € X} = sup{G(y) :y € ¥} = sup f(a, y) : (a,y) © Xx}. 
Let X,Y be nonempty sets and let f : X x Y > R be a function with 
bounded range. Let 
F(x) =sup{f(,y):y€ Y} and A(y) = inf{f(x,y): a € X}. 
Prove that 
sup{H(y): ye Y} < inf{F(a): ae X}. 
Let X = Y = [0,1]. Perform the computations of Exercise 19 for each of 
the following functions f(z, y). 
lo @=y, 


*a. f(x,y) = 30 + 2y b. Kea= {1 ey 


29 
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21. Let J be a subset of R that has the following property: if x,y € J with 
x < y, then t € J for every t satisfying « < t < y. Prove that J is an 
interval as defined in Definition 1.4.8. 


1.5 Consequences of the Least Upper Bound 
Property 


In this section, we look at a number of elementary properties of the real num- 
bers which in more elementary courses are usually always taken for granted. 
As we will see however, these are all actually consequences of the least upper 
bound property of the real numbers. 


THEOREM 1.5.1 (Archimedian Property) [f x, y €¢ R and x > 0, then 
there exists a positive integer n such that 


nx > y. 


Proof. If y < 0, then the result is true for all n. Thus assume that y > 0. We 
will again use the method of proof by contradiction. Let 


A={nx:neN}. 


If the result is false, that is, there does not exist an n € N such that nz > y, 
then nx < y for all n € N. Thus y is an upper bound for A. Thus since A # 9, 
A has a least upper bound in R. Let a = supA. Since x > 0,a—a2 <a. 
Therefore a — x is not an upper bound and thus there exists an element of A, 
say mz such that 

a-xX%< me. 


But then a < (m+ 1)z, which contradicts the fact that a is an upper bound 
of A. Therefore, there exists a positive integer n such that nx > y. 


Remark. One way in which the previous result is often used is as follows: given 
€ > 0, there exists a positive integer n, such that nge > 1. As a consequence, 


1 
—<e€ 
n 


for all integers n, n > no. 


THEOREM 1.5.2 /fa2,y ¢R and x < y, then there exists r € Q such that 


LS RY: 
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Proof. Assume first that « > 0. Since y— x > 0, by Theorem 1.5.1 there 
exists an integer n > 0 so that 


n(y—-x2)>1 or ny>1ltne. 


Again by Theorem 1.5.1, {k €¢ N: k > nx} is nonempty. Thus by the well 
ordering principle there exists m € N such that 


m-1l<nx<m. 


Therefore 
nxe<m<l+nz < ny, 

or dividing by n, 

m 

Tc —<y. 

n 
If « < 0 and y > 0, then the result is obvious. Finally, if « < y < 0, then by 
the above there exists r € Q such that -—y <r <—a,ie,¢2<—r<y. 


The conclusion of Theorem 1.5.2 is often expressed by the statement that 
the rational numbers are dense in the real numbers, that is, between any two 
real numbers there exists a rational number. A precise definition of “dense” 
is given in Definition 2.2.19. 


Another consequence of the least upper bound property is the following 
theorem concerning the existence of nth roots. 


THEOREM 1.5.3 For every real number x > 0 and every positive integer 
n, there exists a unique positive real number y so that y” =x 


The number y is written as %/z or am and is called the nth root of x. 
The uniqueness of y is obvious. Since the existence of y will be an immediate 
consequence of the intermediate value theorem (Theorem 4.2.11), we omit the 
details of the proof in the text. A sketch of the proof of Theorem 1.5.3 using 
the least upper bound property is included in the miscellaneous exercises. It 
should be emphasized that the proof of Theorem 4.2.11 also depends on the 
least upper bound property. 


COROLLARY 1.5.4 If a, b are positive real numbers and n is a positive 
integer, then : hele 

(ab)™ =arb~. 
Proof. Set a = a!/" and 8 = b!/”. Then 


ab = a" B” = (ap)”. 


1/n 


Thus by uniqueness, a8 = (ab) 
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Exercises 1.5 
1. *Ifr and s are positive rational numbers, prove directly (without using 
the supremum property) that there exists an n € N such that nr > s. 


2. Given any x € R, prove that there exists a unique n € Z such that 
n-l<a<n. 


3. Ifr 40 is a rational number and z is an irrational number, prove that 
r +a and rz are irrational. 


4. *Prove directly (without using Theorem 1.5.2) that between any two 
rational numbers there exists a rational number. 


Ifx, y € R with x < y, show that x < te+(1—-t)y < y forallt,0<t<1. 


*a. Prove that between any two rational numbers there exists an irra- 
tional number. 


*b. Prove that between any two real numbers there exists an irrational 
number. 


7. Ifx> 0, show that there exists n € N such that i” <a. 


8. *Let 2,y € R with x < y. If u € R with u > 0, show that there exists a 
rational number r such that « < ru < y. 


9. Let B={r€Q:r>0 and r? < 2} and a=supB. Prove that a? = 2. 


1.6 Binary and Ternary Expansions® 


In our standard base 10 number system we use the integers {0,1,...,9} to 
represent real numbers. Base 10 however is not the only possible base. In 
base 3 (ternary) we use only the integers {0,1,2}, and in base 2 (binary) 
we use only {0,1}. In this section, we will show how the least upper bound 
property may be used to prove the existence of the expansion of a real number 
z,0< a <1, for a given base. For purposes of illustration, and for later use, 
we will use base 2 and 3, which are commonly referred to as the binary and 
ternary expansions respectively. 


In base ten, given the decimal .1021, what we really mean is the real 


number given by 
1 0 2 1 


| 
10 * 102 * 103 * 107" 
However, in base 3, the expansion .1021 represents 


ee ae ee 
3. 32 3834? 


3This section can be omitted on first reading. The ternary expansion of a real number 
is only required in Section 2.5 and can be covered at that point. 
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which is the ternary expansion of 34/81. 
For a given x, 0 < x < 1, the ternary or base 3 expansion of x is defined 
inductively as follows: 


DEFINITION 1.6.1 Let ni € {0,1,2} be the largest integer such that 


ry 
eis Hs 
3 


Having chosen ny,...,N%, let ne+1 € {0,1,2} be the largest integer such that 


If we set 


Ny Nk 
p= {" ae we k=1,2,.h, 
aa 


then E £0 and E is bounded above by x. As we will shortly see, sup E = 2. 
In terms of series, which will be covered in detail later, we have 


co 
Soo 
k=1 


The binary expansion of x, or the expansion of x to any other base, is 
defined similarly. For the binary expansion, the integer nz at each step is 
chosen as the largest integer in {0, 1}. 


EXAMPLES 1.6.2 (a) We now use the above definition to obtain the 
ternary expansion of z At the first step, we must choose n, as the largest 
integer in {0,1,2} such that 

Ny i 
a 8 
This inequality fails for ny = 1, 2. Thus n; = 0. To find nz, we choose the 
largest integer nz € {0,1,2} such that 


which is satisfied by no = 2. To find n3 we must have 


0-5 2 ee 
3 i a 


It is left as an exercise to show that this is satisfied for n3 = 0, 1, 2. Thus we 
take n3 = 2. At this stage we conjecture that n, = 2 for all k > 2, and that 


; = .02222... (base 3). 
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To see that this indeed is the case we use the fact that for the geometric series 


= 1 
YS ; O<r<l. 
(Li) 
k=0 
Thus : 
DST 2 1 1 
0222... = = a =, 
en 5 (3) -gr373 
k=2 k=0 3 


In (c) we will illustrate how mathematical induction may also be used to prove 
such a result. The above ternary expansion is not unique. The number 5 also 
has a finite expansion 


1 
rae .1000... (base 3). 


We will discuss this in more detail at the end of this section. 


(b) The binary expansion of } is given by 
1 
a 010101... (base 2). 


This expansion can be obtained using the definition and induction (Exercise 
4). Alternately, using the geometric series we have 


010101 owe eee 
iS Doge 9 a) = 3 


(c) The ternary expansion of 4 is given by 
1 
a ATT yes (base 3). 


We now show in detail how this expansion is derived. Since 3 < $ and 2 > 5, 
n, = 1. We will use the second principle of mathematical induction to prove 
that nz, = 1 for all k € N. By the above, the result is true fork = 1. Letk > 1 
and assume that n; = 1 for all 7 < k. By definition n, is the largest integer 
in {0,1,2} such that 


1 1 Nk 1 
dl adel eet ol He 3 
gt a ae SS (3) 
_ pntl 
Using the identity r+7r?+---+r = ae ee r #1, (Example 1.3.2(a 
8 l-r 


with n = k — 1, we obtain 
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Substituting into equation (3) and multiplying by 2 gives 

1-—+—, <1. 
This inequality is true if n, = 0 or 1 and is false if nz, = 2. Since nz is to be 


chosen as the largest integer of {0, 1,2} for which (3) holds, n; = 1. Thus by 
Theorem 1.3.3 nz = 1 for all k EN. 


THEOREM 1.6.3 Let « € R with 0 < 2 < 1, and with {n,} as defined in 
Definition 1.6.1 let 


Nk 
g={7 i we k=1,2,..}. 
tet ae 


Then sup E = a. 


Proof. Let a = sup E. Since x is an upper bound, a < x. Suppose a < a. 
Let k be the smallest positive integer such that 


1 
3k <“£-a or a+ 3k <2 
Since a = sup E, 
ny Nk 
mee 1 4 
m1 | , tk — ny Nk-1 Nk 
Pree pf Se pet 
3 3k 3k 3 gk-1 3h 
If nz = 0 or 1, then this contradicts the choice of nz. If nz = 2, then we have 
-1+1 
ote +B <o. 


If any nj, 1 < 7 < k—1 is 0 or 1, we have a contradiction to the choice of n;. 
If all the n; = 2, then we obtain 
D> Gl 


—+— <1 
3 ge ‘ 


which is also a contradiction. 


The expansion 
v= .NjynNgnN3.... 


is finite or terminating if there exists an integer m € N such that nz, = 0 
for all k > m. Otherwise, the expansion is infinite or nonterminating. The 
expansion of a real number in a given base is not always unique; when «x has 
a finite expansion, it also has an infinite expansion as well. For the ternary 
expansion, when 


a=—, a€N with 0<a<3", 
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and 3 does not divide a, then x has a finite expansion of the form 


et He gsm am € {1,2}, 


2 
a= 3 aie a > aE when @m = 1, or 
k=m-+1 
ay 1 5. “2 
Begg og when adm = 2. 


Exercises 1.6 


1. Find the ternary expansion of each of the following. 
b. 4 


* Jos 
a. 73 


1 
4 
2. Find the real number determined by each of the following finite or infinite 
binary expansions. In the case of an infinite expansion use the geometric 
series as in Example 1.6.2 (c) to determine your answer. 
a. .1010 b. .101010--- *c. .0101 


*d. .010101--- —e. .001001 *f. .001001--- 


3. Find the real number determined by each of the following finite or infinite 
ternary expansions. 


*a. 0022 b. .00222-.-- c. .1010 
*d. .101010--- e. .001001001--- *f. .121212-.- 
4. *Find the binary expansion of 3 Use induction to prove the result. 
5. *Find both the finite and infinite binary expansions of 3. 
6. If0<2< 1, prove that the infinite ternary expansion of x is unique. 
te Ab = a with a € N odd, and 0 < a < 2”, show that x has a finite 
binary expansion of the form 
a1 Am 
Seg com mal, 
c= ae a 
and an infinite expansion 
a 0 6 1 
c= Pet are eee 
eee 


1.7 Countable and Uncountable Sets 


In discussing sets, we all have an intuitive understanding of what it means 
for a set to be finite or infinite, and what it means for two finite sets to be 
of the same size; that is, to have the same number of elements. For example, 
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the sets A = {2,7,11,21} and B = {7,3,19, 32} both have the same number 
of elements; namely, four. We accomplish this by counting the number of 
elements in each of the two sets. Alternately, the same can be accomplished, 
without counting, by simply pairing up the elements; i.e., 


752 
307 
19411 
32 4 21 


For infinite sets, the concept of two sets being of the same size or having 


the same number of elements is vague. For example, let S denote the squares 
of the positive integers; namely, 


ee Wet a reeere 


Then on one hand, S$ is a proper subset of the positive integers N, yet as 
Galileo (1564-1642) observed, the sets N and S' can be placed into a one-to- 
one correspondence as follows: 


> 1 
2 «5 ?? 
3 > 38? 


This example caused Galileo, and many subsequent mathematicians, to con- 
clude that the standard notion of “size of a set” did not apply to infinite sets. 
Cantor on the other hand realized that the concept of one-to-one correspon- 
dence raised many interesting questions about the theory of infinite sets. In 
this section, we take a closer look at infinite sets and what it means for an 
infinite set to be countable. We begin by defining the concept of equivalence 
of sets. 


DEFINITION 1.7.1 Two sets A and B are said to be equivalent (or to 
have the same cardinality), denoted A ~ B, if there exists a one-to-one 
function of A onto B. 


The notion of equivalence of sets satisfies the following: 
(i) Aw~A. (reflexive) 
(ii) IfA~B,then B~ A. (symmetric) 
(iii) IfA~ Band B~C,then A~C. (transitive) 
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DEFINITION 1.7.2 For each positive integer n, let N, = {1,2,...,n}. As 
in Section 1, N denotes the set of all positive integers. If A is a set, we say: 
(a) A is finite if A~N,, for some n, or if A=90. 
(b) A is infinite if A is not finite. 
(c) A is countable if A~N. 
(d) A is uncountable if A is neither finite nor countable. 
(e) A is at most countable if A is finite or countable. 


The reader might want to ponder Exercise 20 at this point. Countable sets 
are often called denumerable or enumerable sets. It should be pointed out 
that some textbooks, when using the term countable, include the possibility 
that the set is finite. 


EXAMPLES 1.7.3 (a) As above, let S = {17, 27,37, ...}. Then the function 
g(n) = n? is a one-to-one mapping of N onto S. Thus $ ~ N and S is countable. 


(b) For our second example, we show that Z ~ N. To see this, consider 
the function f : N - Z defined by 


(n even), 


5 (n odd). 


The following diagram illustrates what the mapping f does to the first few 
integers. 


1 — 0 
2 — 1 
3 — -!1 
4 —> 2 
5 — -2 


It is left as an exercise (Exercise 1) to show that this function is a one-to-one 
mapping of N onto Z. Thus Z ~ N, and the set Z is also countable. 


As another illustration of countable sets consider the following theorem. 
THEOREM 1.7.4 N x N is countable. 


Proof. For this example, it is easier to construct a one-to-one mapping of 
N x N onto N. Such a function is given by 


f(m,n) = 27-7 (2n — 1). 
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It is left as an exercise (Exercise 3) to show that f as defined is a one-to-one 
mapping of N x N onto N. 


One of our goals in this section will be to show that the set Q of rational 
numbers is countable. 


Sequences 


DEFINITION 1.7.5 Jf A is a set, by asequence in A we mean a function 
f from N into A. For eachn €N, let x, = f(n). Then x, is called the nth 
term of the sequence f. 


For notational convenience, sequences are denoted by {2,}°2, or just 
{x,}, rather than the function f. Note however the distinction between 
{xn }°2,, which denotes the sequence, and {z, : n = 1,2,...} which denotes 
the range of the sequence. For example, {1 — (—1)"} denotes the sequence f 
where 

f(n) = a = 1-(-1)". 
On the other hand, {rp :n =1,2,...} = {0,2}. 

By definition, if A is a countable set, then there exists a one-to-one function 

f from N onto A. Thus 


A= Range f = {t, :n =1,2,....}. 


The sequence f is called an enumeration of A, ie, A = {a, :n = 1,2,...} 
with r, # ®», whenever n # m. This ability to enumerate elements of a 
countable set plays a key role in the proofs of some of the following results. 


THEOREM 1.7.6 Every infinite subset of a countable set is countable. 


Proof. Let A be a countable set and let {x, :n = 1,2,...} be an enumeration 
of A. Suppose F is an infinite subset of A. Then each x € FE is of the form 
x, for some k € N. We inductively construct a function f : N - E as follows: 
let ny be the smallest positive integer such that z,, € E. Such an integer 
exists by the well ordering principle. Having chosen nj, ....,n%—1, let ng be the 
smallest integer greater than nx_1 such that rp, € E \ {@n,,...,0n,_, }. Set 
f(k) = %p,. Since E is infinite, f is defined on N. 

Ifm >k, then nm > nx and thus ty, # Ln,. Therefore f is one-to-one. 
The function f is onto since if x € £, then x = x; for some j. By construction, 
nz = Jj for some k, and thus f(k) = x. 


THEOREM 1.7.7 If f maps N onto A, then A is at most countable. 


Proof. If A is finite, the result is certainly true. Suppose A is infinite. Since 
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f maps N onto A, each a € A is of the form f(n) for some n € N. For each 
a € A, by the well ordering principle 


f-*({a}) = {n EN: f(n) = a} 


has a smallest integer, which we denote by nq. Consider the mapping a > na 
of A into N. If a ¥ b, then since f is a function, ng # np. Also, since A is 
infinite, {nq : a € A} is an infinite subset of N. Thus the mapping a > n, is a 
one-to-one mapping of A onto an infinite subset of N. Therefore by Theorem 
1.7.6 A is countable. 


Indexed Families of Sets 


In Section 1 we defined the union and intersection of two sets. We now extend 
these definitions to larger collections of sets. Recall that if X is a set, P(X) 
denotes the set of all subsets of X. 


DEFINITION 1.7.8 Let A and X be nonempty sets. An indexed family 
of subsets of X with index set A is a function from A into P(X). 


If f: A P(A), then for each a € A, we let EF. = f(a). As for sequences, 
we denote this function by {Eu}aea. If A = N, then {E,}nen is called a 
sequence of subsets of X. In this instance, we adopt the more conventional 
notation {E,,}°2, to denote {En }nen. 


EXAMPLES 1.7.9 The following are all examples of indexed families of 
sets. 

(a) The sequence {N,,}°2,, where N,, = {1,2,...,m}, is a sequence of sub- 
sets of N. 

(b) For each n € N, set J, = {mt €R:0< a < 4}. Then {J}, isa 
sequence of subsets of R. 

(c) For each x, 0< a <1, let 


E,={reQ:0<r<a}. 


Then {Fz} e(0,1) is an indexed family of subsets of Q. In this example, the 
open interval (0,1) is our index set. 


DEFINITION 1.7.10 Suppose {Ea}aca is an indexed family of subsets of 
X. The union of the family of sets {Ea}aea 1s defined to be 


J Ba ={w eX :2€ Eq for some a € A}. 
acA 


The intersection of the family of sets {Eahaca is defined as 


() Ba ={v EX :2€ Ey, for alla € A}. 
acA 
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If A=N we use the notation 


U FE, and q En instead of U FE, and () En 
n=1 


n=1 neN neN 


respectively. Also, if A = Nx, then 


k 
U FE, is denoted by U En, 
n=1 


neN, 


with an analogous definition for the intersection. Occasionally, when the index 
set A is fixed in the discussion, we will use the shorthand notation be Ea or 


(),. Ha rather than U Ey or () Ey: 
acA acA 


EXAMPLES 1.7.11 We now consider the union and intersection of the 
families of sets given in the previous example. 
(a) With N,, = {1,2,...,n}, we have 


(Na =). and UJ Na =N. 
n=1 


n=1 


Since 1 is the only element which is in N,, for all n, (),, Nx = {1}. For the 
union, since N,, C N for all n, U,, Nn C N. On the other hand, if n € N, then 
n € Nn, and as a consequence, N C U,, Nn, which proves equality. 


(b) As in the previous example, for n € N let I, = {t €R:0< a < +}. 
We first show that > 
eae 


n=1 


Suppose not, then there exist x € R such that x € I, for all n, ice., 
1 
0<a<-, for all neEN. 
n 


This however contradicts Theorem 1.5.1 which guarantees the existence of a 
positive integer n such that nz > 1. For the union, since I, C J; for all n > 1, 


U m=h={eeER:0<a2< 1}. 
n=1 


(c) We leave it as an exercise (Exercise 9) to show that if Ey is defined as 
in Example 1.7.9(c), ie., Ey ={r€Q:0<r <2}, then 


() Ex ={O}, and LJ Be={reQ:0<r<]}. 


xe (0,1) x€(0,1) 
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As for a finite number of sets, we also have analogs of the distributive laws 
and De Morgan’s laws for arbitrary unions and intersections. 


THEOREM 1.7.12 (Distributive Laws) If Ea, a € A, and E are subsets 
of a set X, then 


(a) eN(U r.) = UJ (En£,), 


acA acA 
(b) EU (Nn e.| = ()(EUE,). 
acA acA 


THEOREM 1.7.13 (De Morgan’s Laws) If {Ea}aeca is a family of sub- 
sets of X, then 


(a) (U z.) = () Ei, 


acA acA 
© (Me) = Uae 
acA acA 


The proofs of both of these theorems, as well as the following analogue of 
Theorems 1.2.5 and 1.2.6 are left to the exercises. 


THEOREM 1.7.14 Let f be a function from X into Y, and let A be a 
nonempty set. 


(a) If {Ea}aea is a family of subsets of X, then 


f (U Ps) =U f(£.), 


acA acA 
Z (Nn Ps) C {) F(Z). 
acA acA 


(b) If {Ba}aea is a family of subsets of Y, then 


i (U Bs) =U f*(Ba), 


acA acA 


a (N Bs) = 1) (Ba). 


acA acA 
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The Countability of Q 


The countability of the set of rational numbers Q will follow as a corollary of 
the following theorem. 


THEOREM 1.7.15 If {E,}°2, is a sequence of countable sets and 


n=1 
then S is countable. 
Proof. Since E,, is countable for each n € N, we can write 
EZ 4 ny RSH TZ 


Since Fy, is an infinite subset of S$, the set S itself is infinite. Consider the 
function h: N x N > S by 
h(n, k) = tn p- 


The function h, although not necessarily one-to-one, is a mapping of N x N 
onto $. Thus since N x N ~N, there exists a mapping of N onto S$. Hence by 
Theorem 1.7.7 the set S$ is countable. 


COROLLARY 1.7.16 Q is countable. 
Proof. For each m € N, let 
Em = { = :neEe zh : 
m 


Then E,,, is countable, and since Q = Cea Em, by Theorem 1.7.15 the set 
Q is countable. 


The Uncountability of R 


In November 1873, in a letter to Dedekind, Cantor asked whether the set R 
itself was countable. A month later he answered his own question by prov- 
ing that R was not countable. We now prove, using Cantor’s elegant “di- 
agonal” argument, that the closed interval [0,1] is uncountable, and thus R 
itself is uncountable. For the proof we will use the fact that as in Section 
6, every x € [0,1] has a decimal expansion of the form 2 = .nyn2--- with 
n; € {0,1,2,...,9}. As for the binary and ternary expansions, the decimal 
expansion is not necessarily unique. Certain numbers such as a5 have two 
expansions; namely 
1 dl 


— = .100--- d ee ES See 
10 00 an 10 0999 


This however will not be crucial in the proof of the following theorem. 
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THEOREM 1.7.17 The closed interval [0,1] is uncountable. 


Proof. Since there are infinitely many rational numbers in [0,1], the set is 
not finite. To prove that it is uncountable, we only need to show that it is not 
countable. To accomplish this, we will prove that every countable subset of 
(0, 1] is a proper subset of [0,1]. Thus [0,1] cannot be countable. 
Let EF = {z,n = 1,2,...} be a countable subset of [0,1]. Then each x, has 
a decimal expansion 
Tn = En 1%n,2Un,3° °° 


where for each k € N, ax, € {0,1,...,9}. We now define a new number 


Y= -U1Y2Y3°°° 


as follows: if tn, < 5, define y, = 6; if tn, > 6, define y, = 3. Then 
y € [0,1], and since y, 4 0 or 9, y is not one of the real numbers with two 
decimal expansions. Also, since for each n € N yn A Xn, we have y # x, for 
any n. Therefore y ¢ FE; i.e., E is a proper subset of [0, 1]. 


Another example of an uncountable set is given in the following theorem. 


THEOREM 1.7.18 If A is the set of all sequences whose elements are 0 or 
1, then A is uncountable. 


Remark. The set A is the set of all functions f from N into {0,1}. Thus a 
sequence f € A if and only if f(n) =0 or 1 for all n. 


Proof. As in the previous theorem, we will also prove that every countable 
subset of A is a proper subset of A, and thus A cannot be countable. 

Let E be a countable subset of A and let {s, :n =1,2,...} be an enumer- 
ation of the set &. For each n, s, is a sequence of 0’s and 1’s. We construct a 
new sequence s as follows: for each k € N, let 


s(k) = 1— sx(k). 


Thus if s;,(k) = 0, s(k) = 1, and if s,(k) = 1, s(k) = 0. Thus s € A. Since for 
all k € N s(k) # sx(k), we have s # s, for any n € N. Therefore s ¢ F, ie., 
EGA. 

In the previous two theorems we proved that the closed interval [0, 1] and 
the set of all sequences of 0’s and 1’s are both uncountable sets. A natural 
question is are these two sets equivalent? Considering the fact that every real 
number x € [0,1] has a binary expansion, which is really a sequence of 0’s 
and 1’s, one would expect that the answer is yes. This indeed is the case 
(Miscellaneous Exercise 5). 
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Exercises 1.7 


1. a. Prove that the function f of Example 1.7.3(b) is a one-to-one function 
of N onto Z. 


b. Find a one-to-one function of Z onto N. 


*c. Find a one-to-one function from N onto O, the set of all odd positive 
integers. 


2. For each of the following determine whether the set is finite, infinite, 
countable, or uncountable. 
a. {1—(-1)":ne€EN} b. {ncosna:n€ N} 
c. {2": ne Z} d. {2 :m,n €N,m odd} 
e. [0,1] \Q f. {x € [0,1] : v has an infinite ternary expansion} 
3. Prove that the function f of Theorem 1.7.4 is a one-to-one function of 
N x N onto N. 
4. *a. If a,b € R with a < 6, prove that (a,b) ~ (0,1). 
b. Prove that (0,1) ~ (0, 00). 
Suppose X, Y, Z are sets. If X ~ Y and Y ~ Z, prove that X ~ Z. 
6. *alf A~ X and B~Y, prove that (A x B)~ (X x Y). 
b. If A and B are countable sets, prove that A x B is countable. 


7. If X ~Y, prove that P(X) ~ P(Y). 


8. Find LU A, and () An for each of the following sequences of sets {An}. 
n=1 n=1 
*a, A, ={x ER: -n<a<n}, nEeN 
b. An ={a@E€R:-1+<2<1}, neNn 
*c, An ={c ER: -1 <a <1+24},neEN 
d. A, ={x€R:0<2¢<1-i} neEN 
*e. An = [4,1-+4],nEN,n>2 
f. A, ={t@ER:in<ax< oo} 


9. For each x € (0,1), let Ey = {r €Q:0<r <x}. Prove that 
() E, = {0} and U BE, ={re€Q:0<r<z}. 
x€(0,1) x€(0,1) 
10. Prove Theorem 1.7.12. 
11. Prove Theorem 1.7.13. 
12. Let f be a function from X into Y. 


*a. If {Ea}aca is a family of subsets of X, prove that 
F(U, Ba) =U, f (Ea). 

b. If {Ba}aea is a family of subsets of Y, prove that 
fe Be) = Mo f* (Ba): 


13. a. If A is a countable subset of an uncountable set X, prove that X \ A 
is uncountable. 


*b. Prove that the set of irrational numbers is uncountable. 
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14. Suppose f is a function from X into Y. If the range of f is uncountable, 
prove that X is uncountable. 


15. *a. For each n € N, prove that the collection of all polynomials in x of 
degree less than or equal to n with rational coefficients is countable. 


*b. Prove that the set of all polynomials in x with rational coefficients 
is countable. 


16. Prove that the set of all intervals with rational endpoints is countable. 


17. Let A be a nonempty subset of R that is bounded above and let a = 
sup A. If a ¢ A, prove that for every «€ > 0, the interval (a — €, a) 
contains infinitely many points of A 


18. *a. Prove that (0,1) ~ (0,1]. (This problem is not easy!) 
b. Prove that (0,1) ~ [0,1]. 


19. *A real number a is algebraic if there exists a polynomial p(x) with 
integer coefficients such that p(a) = 0. Prove that the set of algebraic 
numbers is countable. 


20. Prove that any infinite set contains a countable subset. 


21. Prove that a set is infinite if and only if it is equivalent to a proper subset 
of itself. 


22. *Prove that any function from a set A to the set P(A) of all subsets of 
A is not onto. 


23. *Prove that [0,1] x [0,1] ~ [0,1]. 


Notes 


The most important concept of this chapter is the least upper bound property of the 
real numbers. This property will be fundamental in the development of the underly- 
ing theory of calculus. In the present chapter we have already seen its application in 
proving the Archimedian property (Theorem 1.5.1). For the rational number system 
this property can be proved directly. For the real number system it was originally 
assumed as an axiom by Archimedes (287-212 B.C.). Cantor however proved that 
the Archimedian property was no axiom, but a proposition derivable from the least 
upper bound property. 

In subsequent chapters the least upper bound property will occur in proofs of 
theorems, either directly or indirectly, with regular frequency. It will play a crucial 
role in the characterization of the compact subsets of R and in the study of sequences 
of real numbers. It will also be required in the proof of the intermediate value theorem 
for continuous functions. One of the corollaries of this theorem is Theorem 1.5.3 on 
the existence of nth roots of positive real numbers. Many other results in the text 
will depend on previous theorems which required the least upper bound property in 
their proofs. 
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The emphasis on the least upper bound property is not meant to overshadow 
the importance of the concepts of countable and uncountable sets. The fact that 
the rational numbers are countable, and thus can be enumerated, will be used on 
several occasions in the construction of examples. In all the examples and exercises, 
every infinite subset of R turns out to be either countable or equivalent to [0, 1]. 
Cantor also made this observation and it led him to ask whether this result was true 
for every infinite subset of R. Cantor was never able to answer this question; nor 
has anyone else. The assertion that every infinite subset of R is either countable or 
equivalent to [0,1] is known as the continuum hypothesis. In 1938 Kurt Gédel 
proved that the continuum hypothesis is consistent with the standard axioms of set 
theory; that is, Godel showed that continuum hypothesis cannot be disproved on the 
basis of the standard axioms of set theory. On the other hand, Paul Cohen in 1963 
showed that the continuum hypothesis is undecidable on the basis of the current 
axioms of set theory. 

Cantor’s creation of the theory of infinite sets was motivated to a great extend by 
problems arising in the study of convergence of Fourier series. We will discuss some 
of these problems in greater detail in Chapters 9 and 10. Cantor’s original work on 
the theory of infinite sets can be found in his monograph listed in the Supplemental 
Readings. 


Miscellaneous Exercises 


1. Let A and B be nonempty sets. For a € A, b € B, define the ordered pair 
(a,b) by 
(a,b) = {{a}, {a, b}}. 
Prove that two ordered pairs (a, b) and (c, d) are equal if and only if a = c 
and b=d. 


The following two exercises are detailed and lengthy. The first exercise is 
a sketch of the proof of Theorem 1.5.3. The second exercise shows how the 
least upper bound property may be used to define the exponential function 
b”,b>1. 


2. Let 
E={teR:t>0andt” < zg}. 
a. Show that E 4 @ by showing that x/(x +1) € E. 
b. Show that 1+ 2 is an upper bound of E. 
Let 
y =sup LE. 
The remaining parts of the exercise are to show that y” = x. This will be 
accomplished by showing that y” <x and y” > « lead to contradictions, 


leaving y” = x. To accomplish this, the following inequality will prove 
useful. Suppose 0 <a<_b, then 


b” — a” = (b—a)(b"* + ab” 7 ++. +0" ") <n(b—a)o™™. = (*) 
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c. Show that the assumption y” < x contradicts y = sup E as follows: 
Choose 0 < h < 1 such that 


xy” 


h< —=_.. 
ny + 1)" 


Use (*) to show that y+he E. 


d. Show that the assumption y” > «x also leads to a contradiction of the 
definition of y as follows: Set 


Show that ift > y—k, thent ¢ E. 
Fix b> 1. 


a. Suppose m, n, p, q are integers with n > 0 and q > 0. If m/n = p/q, 
prove that 

omyi/n = Pye 
Thus if r is rational, b” is well defined. 
b. If r, s are rational, prove that b’T*° = b" b°. 
c. Ifa ER, let B(x) = {b' :t € Qt < a}. Prove that b” = sup B(r) when 
r €Q. Thus it now makes sense to define b” = sup B(x) when x € R. 


d. Prove that b”*¥ = b”b” for all real numbers 2, y. 


The following result, known as the Schroder-Bernstein theorem, is non- 
trivial, but very important. It is included as an exercise to provide mo- 
tivation for further thought and additional studies. A proof of the result 
can be found in the teat by Halmos listed in the Supplemental Reading. 


Let X and Y be infinite sets. If X is equivalent to a subset of Y, and Y 
is equivalent to a subset of X, prove that X is equivalent to Y. 


As in Theorem 1.7.18, let A denote the set of all sequences of 0’s and 1’s. 
Use the previous result to prove that A ~ (0, 1]. 


DEFINITION. A complex number is an ordered pair (a,b) of real 
numbers. If z = (a,b) and w = (c,d), we write z = w if and only if 
a =c and b = d. For complex numbers z and w we define addition and 
multiplication as follows: 


z+w=(a+c,b4+d) 
z-w = (ac — bd,ad + bc). 
The set of ordered pairs (a,b) of real numbers with the above operations 
of addition and multiplication is denoted by C. 
a. Prove that (C,+,-) with zero 0 = (0,0) and unit 1 = (1,0) is a field. 
b. Set i = (0,1). Show that i? = —1. 
c. Prove that C is not an ordered field. 


Supplemental Reading 
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Topology of the Real Line 


In this chapter, we introduce some of the basic concepts fundamental to the 
study of limits and continuity, and study the structure of point sets in R. The 
branch of mathematics concerned with the study of these topics—not only for 
the real numbers but also for more general sets—is known as topology. Modern 
point set topology dates back to the early part of the 20th century; its roots, 
however, date back to the 1850s and 1860s and the studies of Bolzano, Can- 
tor, and Weierstrass on sets of real numbers. Many important mathematical 
concepts depend on the concept of a limit point of a set and the limit process, 
and one of the primary goals of topology is to provide an appropriate setting 
for the study of these concepts. 

One of the first topics encountered in the study of calculus is the concept 
of limit, which requires the notion of closeness, or the distance between points 
becoming small. On the real line or in the euclidean plane, the distance be- 
tween points is usually measured as the length of the straight line segment 
joining the points. However, in many instances in subsequent chapters our 
points will not be points on the line or in the plane, but rather functions de- 
fined on some set. For this reason we introduce the concept of distance on an 
arbitrary set and study metric spaces in general. In many instance, the proofs 
of the results are such that they are valid in any metric space, and will be 
stated as such. These more general results about arbitrary metric spaces will 
prove useful not only in subsequent chapter but also in other courses. 

Even though we introduce abstract metric spaces, our primary emphasis in 
this chapter will be on the topology of the real line. A thorough understand- 
ing of the topics on the real line and the plane will prove invaluable when 
they are encountered again in more abstract settings. On first reading, the 
concepts introduced in this chapter may seem difficult and challenging. With 
perseverance, however, understanding will follow. 


2.1 Metric Spaces 


We begin our study of metric spaces with a review of distance between points 
in the real numbers or its geometric interpretation as the real line. 


ol 
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DEFINITION 2.1.1 For a real number x the absolute value of x, denoted 


|x|, is defined by 
x, ifx > 0, 
|z| = ; 
=f; ifxe <0. 
For example, |4| = 4 and | — 5| = 5. From the definition, |x| > 0 for all 
x € Rand |a2| = 0 if and only if x = 0. This last statement follows from the fact 
that if « #0, then —x 4 0 and thus |x| > 0. The following theorem, the proof 


of which is left to the exercises, summarizes several well known properties of 
absolute value. 


THEOREM 2.1.2 (a) | — x| = |z| for allx ER. 
(b) |xy| = |z||y| for all x,y ER. 
(c) |a| = Vx? for all € R. 
(d) Ifr > 0, then |x| < r if and only if -—r<a<r. 
(e) —|r| <a < |a| for alla eR. 


The following inequality is very important and will be used frequently 
throughout the text. 


THEOREM 2.1.3 (Triangle Inequality) For all x,y € R, we have 
jz + y| < |a| + [yl 
Proof. The triangle inequality is easily proved as follows: For x,y € R, 


O< (e+y)* =a? + 2eyty? 
< jal? + larly] + [yl? = (al + [yl)?. 


Thus by Theorem 2.1.2(c), 


Jat yl = Va ty)? < V(lal + lyl)? = la] + ly 


As a consequence of the triangle inequality we obtain the following two 
useful inequalities, the proofs of which are left to the exercises. 


COROLLARY 2.1.4 For all x,y,z € R we have 
(a) |v —y| <|x—2|+|z—y], and 
(b) ||x| —|yl| < |x — yl. 


In the following example we illustrate how properties of absolute value can 
be used to solve inequalities. 


EXAMPLE 2.1.5 Determine the set of all real numbers x that satisfy the 
inequality |2x + 4| < 8. By Theorem 2.1.2(d), |2x + 4| < 8 if and only if 
—8 < 2x+4 < 8, or equivalently, —12 < 2x < 4. Thus the given inequality is 
satisfied if and only if -6 <a < 2. 
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Geometrically, |x| represents the distance from x to the origin 0. More 
generally, for z,y € R, the euclidean distance d(x, y) is defined by 


d(a,y) = |# — yl. 


For example, d(—1,3) = | — 1 — 3] = 4 and d(5,—2) = |5 — (—2)| = 7. The 
distance d may be regarded as a function on R x R which satisfy the following 
properties: d(x, y) > 0, d(x, y) = 0 if and only if « = y, d(x, y) = d(y, x), and 


d(x, y) < d(x, z) + d(z,y) 
for all x,y,z € R. We now extend the notion of distance to sets other than R. 


DEFINITION 2.1.6 Let X be a nonempty set. A real valued function d 
defined on X x X satisfying 

(1) d(x, y) > 0 for all x,y EX, 

(2) d(z,y) = 0 of and only if x = y, 

(3) d(x, y) = dy,2), 

(4) d(z,y) < a z)+d(z,y) for all x,y,z ER, 
is called a metric or distance function on X. The set X with metric d is 
called a metric space, and is denoted by (X,d). 


Before we continue, let us reflect on properties (1) to (4) in the definition of 
a metric. The first two combined simply state that distance is nonnegative and 
that the distance between two points is zero if and only if they are the same. 
Property (3) is symmetry; namely the distance between x and y is the same 
as the distance between y and x. Property (4) is again called the triangle 
inequality for the metric d. This inequality simply states that the distance 
between x and y is less than or equal to the distance between x and z, and z 
and y, for any other point z in the space X. All of these properties are what 
we intuitively expect a distance function to satisfy. 


EXAMPLES 2.1.7 We now provide several examples of metrics and metric 
spaces, including the standard metrics on the euclidean plane R?. For some of 
the examples we prove that the functions as defined are indeed metrics, the 
others are left as exercises. 


(a) The real numbers R with the euclidean metric d(z,y) = |a — y| is 
certainly a metric space. The metric is referred to as the usual metric on R. 


(b) Let X be any nonempty subset of R. For x,y € X define 


d(a,y) = |x — yl. 


The distance between the points x and y is just the usual euclidean distance 
between x and y as points in R. However, it is important to remember that 
our space is the set X, and not R. 
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(c) Let X be any nonempty set with 


1, ifp Aq, 
ano= {i apes 


This metric is usually referred to as the trivial metric on X. 


(d) In this example, we consider euclidean space 
R? =R x R= {(x1, 22) : 21,22 € R}. 
For convenience we denote a point (p1,p2) € R? by p. For such a point p 


define 
lPll2 = \/ pi + Ps. 


The quantity ||p|lz is called the euclidean norm of p. Given two points 
P = (71, P2) and q = (41, q2) set 


d2(p, q) = ||P — allo = V(p1 — 11)? + (p2 — @)?. 


By the Pythagorean theorem d2(p,q) is the euclidean distance between the 
points p and q. 

Since the square root is nonnegative, d2(p,q) > 0 for all p,q € R?. Also, 
from the definition it follows immediately that do(p,q) = 0 if and only if 
p = q. Clearly, d2(p,q) = d2(q, p). Hence dz satisfies properties (1)—(3) of a 
metric. For the proof of property (4) we need that || ||2 satisfies the triangle 
inequality, namely 

Ip + all2 < ||pll2 + llazll- 


Assuming that || ||2 satisfies the triangle inequality, given any three points 
p.q,r € R?, we have 


d2(p,q) = ||p — all2 = ||((P— vr) + (r—Qq)|l2 
< ||[p — rll + ||r — all2 = do(p,r) + do(r,q). 


A geometric proof of the triangle inequality follows from the simple fact 
that in a triangle, the length of any one side does not exceed the sum of the 
lengths of the other two sides. This inequality can also be proved algebrically 
(Exercise 9) 


(e) Again we let X = R?. In the previous example the distance between 
points was measured as the length of the straight line segment joining the 
two points. This metric however is of little use if one is in a city, such as New 
York, where the streets are laid out in a rectangular pattern. In such a setting 
a more appropriate way to measure distance is along the actual path one needs 
to traverse to get from one point to another. Specifically, for p,q € R? set 


di (p,q) = |pi — a1| + |p2 — al. 
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Another metric often encountered in R? is the metric ds, which for p,q € 
R? is defined as 


doo (p,q) = max{|p1 — qil, |p2 — al}. 
That d, and dx are indeed metrics on R? is left to the exercises (Exercise 10). 
(f) In the previous two examples we restricted our discussion to R? pri- 
marily for purposes of illustration. It is easier to visualize these concepts in 


the plane as opposed to higher dimensional space. All three of these metrics 
however have natural extensions to R”, where for n € N,n > 2, 


R” = {(a1,...,2n): a; €R,t=1,...,n}. 


Here (21,...,2%n,) denotes the ordered n-tuple of real numbers 21,...,2,. As 
for ordered pairs, two n-tuples (a1,...,2%n) and (yi,.-.,Yn) are equal if and 
only if x; = y; for alli = 1,...,n. The euclidean metric dy for R” is defined 


as follows: if p,q € R” with p = (pi,...,pn) and q = (q1,.--,@n), then 


d2(p,q) = (pi — 11)? +++ + (Pn — Qn)? 


In the miscellaneous exercises we outline how to prove that d2 is a metric on 
R”. An alternate proof will be provided in Chapter 7. The metrics d; and dx 
also have analogous extensions to R”. 


(g) For this example we let X = {p € R?: ||pll2 < 1}. For p,q € X, 
define 


Hed |p — qll2, if p,q are co-linear through 0, 
PD "Liplle + llalle, otherwise. 


This metric space is sometimes referred to as the Washington D. C. space or 
the French Railway space. To see the connection one has to be familiar with 
how the main roads run in Washington or how the railroads run in France 
with regard to the city of Paris. In Washington (excluding the beltway) all 
the major roads run to the city center. Similarly in France, all the major rail 
lines run through Paris. Thus if one travels between points p and q on the 
same line, the distance is just the usual distance between the points. However, 
if p and q are on different lines, then the distance between p and q is the 
distance from p to Paris plus the distance from Paris to q. By computing 
the distance between the points in Exercise 11 one can verify that this is 
how distance is measured in this metric. Plotting the points in the plane will 
further illustrate this metric. 


(h) Let A be any nonempty set. A real-valued function f is bounded on 
A if there exists a positive constant M such that |f(x)| < M for all x € A. Let 
X be the set of all bounded real-valued functions on A. For f,g € X define 


d(f, 9g) = sup{| f(x) — g(@)| + x € A}. 
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Clearly, since f and g are bounded, {| f(x) — g(x)| : x € A} is bounded above, 
and thus d(f,g) < oo. 

Since this is our first example of a space where the elements are functions 
we proceed to show that d is a metric. Clearly d is nonnegative. Furthermore, 
since | f(x)—g(x)| < d(f,g) for alla € A, d(f,g) = 0 if and only if f(x) = g(x) 
for all a € A. That d(f,g) = d(g, f) follows from the fact that | f(x) — g(a)| = 
\g(a)—f(x)|. It only remains to be shown that d satisfies the triangle inequality. 
Let f,g, be bounded functions on A. Then for « € A 


|f(@) — g(a)| = [fF (a) — h(x) + h(@) — g(@)| 
< |f(x) — h(w)| + |h(a) — g(@)| S$ d(f,h) + d(h, 9). 


Therefore d(f, h)+d(h, g) is an upper bound for the set {| f(a)—g(a)| : x € A}, 
and as a consequence, 


U(f,g) < d(f,h) + d(h, 9). 


This then proves that d is a metric on X. 


Exercises 2.1 


1. Prove Theorem 2.1.2. 
2. *Prove Corollary 2.1.4 
Prove that for 71,...,%n € R, |vi +--+ +an| < fri] +--+ + |rn|. 


4. Ifa,b€R, prove that |ab| < 4(a? +0”). 


Determine all x € R that satisfy each of the following inequalities. 
*a. (3a —2| < 11, b. |2? — 4| <5, 
*e. |x| + |a—1| <3, d. |x —1| < |x+1J. 


6. Determine and sketch the set of ordered pairs (x, y) in R x R that satisfy 
the following: 
a. |o| = yl, b. |x| <|yl, 
c. |xy| < 2, d. |a| + |y| <1. 


7. Determine which of the following are metrics on R. 
a.d(x,y)=(e-y)*. be d(a,y) = Va — yl 
*c. d(x,y) = In(14+ |x — y|). 
d. d(x, y) = |3a — y|. 
e. d(x, y) = /|x— y|8. 
If d is a metric on X, prove that |d(a, z) — d(z,y)| < d(a,y). 


9. For p= (pi, p2) € R?, let ||p||z be defined as in Example 2.1.7(d). Prove 
algebraically that 


Ip + qll2 < |lpll2+|lall2 for allp,qeR’. 
10. Prove that d; and do as defined in Example 2.1.7(e) are metrics on R?. 
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11. Let d be the metric on R? defined in Example 2.1.7(g). 


a. Compute the distance in this metric between each of the following pair 
of points: *i. (3,4) (—3,—-F) *ii. (5,5), (0,1) iii. (5,3), ($4) 
b. Prove that d is a metric on R?. 

12. Let A = [0,1] and let X denote the bounded functions on A. Let d be 
the metric on X defined in Example 2.1.7(h). Compute d(f,g) for each 
of the following pairs of functions f and g. 


a. f(e)=1, 9(a)=2. *b. fle) =2, g(x) = 27. 
0, O<2<i, 
ca) = gfe) =f Lege i. 


13. Let p and o be metrics on a set X. Show that each of the following are 
also metrics on X. 


i.2p ii, p+o_ iii. max{p,o}. 
14. *Prove that d defined by 


d(x, y) = 1 fat z,y €R, is a metric on R. 


15. Let X = (0,co). For z,y € X, set 


p(z, y) = 


1 
i | . Prove that p is a metric on X. 
ct sYy 


2.2 Open and Closed Sets 


In Chapter 1 we have used the terms open and closed in describing intervals 
in R. The purpose of this section is to give a precise meaning to the adjectives 
open and closed, not only for intervals, but also for arbitrary subsets of R or 
a metric space (X,d). Before defining what we mean by an open set we first 
define the concept of an interior point of a set. 


DEFINITION 2.2.1 Let (X,d) be a metric space and let p € X. Fore > 0, 
the set 
N.(p) = {2 € X : d(p, x) < €} 


is called an e-neighborhood of the point p. 


Whenever we use the term neighborhood, we will always mean an 
e-neighborhood with € > 0. 


EXAMPLES 2.2.2 In the following examples we consider the e-neighborhoods 
of the metric spaces given in Examples 2.1.7 
(a) Consider R with the usual metric d(x,y) = |x — y|. Then for fixed 
p€Rande>O0, 
N.(p) = {x@:p-—e<a<pte} 
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In this case, N.(p) is the open interval (p — €,p + €) centered at p with radius 
€. 


(b) Let X = [0,00) with d(x,y) = |x — y|. With « = 4 and p = , 
Ny (2) = {2 € (0,00) : la - 3] <3} 
3 


= {x € [0,00):-4<a< 3} =(0, 3). 
On the other hand, Ni (4) = (0, 3). If p = 0, then for any € > 0, 
N-.(0) = {a € [0,00) : |a| < €} = [0,€). 


Thus an e-neighborhood of 0 is the half-open interval [0, €). It is important to 
remember that in this example our space is the interval [0,00) and not R. 

(c) Consider R? with the metric dz of Example 2.1.7(d). For fixed a = 
(a1, @2) and « > 0, 


N.(a) = {x € R?: ||x —all2 < €} 
= {(x1, 22) : (1 — a1)? + (a2 — a)? < e*}. 
This is easily recognized as the interior of a circle with center a and radius e€. 
(Figure 2.1) Although e-neighborhoods in the plane R? are typically drawn as 


circular regions, this is only the case for the metric dz. For other metrics this 
need not be the case as is illustrated in Exercise 5 of this section. 


x2 


FIGURE 2.1 
N-,(a) for the metric dz 
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(d) Let A = [a,b] and X the set of real-valued functions on A with the 
metric as given in Example 2.1.7(h). For a fixed f € X and e>0, 


N.(f) = {9 € X : sup| f(x) — g(x)| < €f-* 


Thus if g € N.(f), then |g(x) — f(x)| < € for all x € A, or equivalently 


f(a) —€< g(#) < fla) +e 


In the following definitions we will assume that X is a nonempty set with a 
metric d. If X = R, unless otherwise specified d will denote the usual euclidean 
metric on R. 


DEFINITION 2.2.3 Let E be a subset of X. A point p € E is called an 
interior point of E if there exists an € > 0 such that N.(p) C E. The set of 
interior points of E is denoted by Int(E), and is called the interior of E. 


EXAMPLES 2.2.4 (a) Let X = R and let EF = (a, 6] with a < b. Every p 
satisfying a < p < 6 is an interior point of E. If € is chosen such that 


0 <e<min{|p — al, |b— pl}, 


then N.(p) C EF. The point b however is not an interior point. For every € > 0, 
N,(b) = (b—€,b+ €) contains points which are not in F. Any « satisfying 
b<a<b+e is not in E. This is illustrated in Figure 2.2. For this example, 
Int(£) = (a, b). 


FIGURE 2.2 
Epsilon neighborhoods of p and b in Example 2.2.4(a) 


(b) Let E denote the set of irrational real numbers, i.e., LE = R\ Q. If 
p © E, then by Theorem 1.5.2, for every € > 0 there exists r € QN N.(p). 
Thus N,(p) always contains a point of R not in E. Therefore no point of E 
is an interior point of F, i.e., Int(F) = 0. Using the fact that between any 
two real numbers there exists an irrational number, a similar argument also 
proves that Int(Q) = 0. 


(c) This example will illustrate that the space X itself is crucial in the 
definition of interior point. Let EF = [0,1) with d(a, y) = |~—y|. We claim that 
every point of £ is an interior point of &. Certainly every p€ E,0<p<1,is 
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an interior point of E. The only point about which there may be some doubt 
is p = 0. However, if 0 < « < 1, then as in Example 2.2.2(b) 


N-.(0) = {a € [0,00) : |a| < €} = (0,6), 


which is a subset of E. Therefore 0 is an interior point of E. Even though 
this appears to contradict our intuition, it does not violate the definition of 
interior point. 


(d) Let X = R? with metric dz, and let 
E={(pi,p2):1< 91 < 3,1 < pz < 2}. 


Given a point p = (p1,p2) € E, if we choose e such that 


0<e < min{|p: — 1], |p. — 3], |p2 — 1], |p2 — 2\}, 


then N.(p) C E. Therefore every point of F is an interior point of F. 


Open and Closed Sets 


Using the notion of an interior point we now define what we mean by an open 
set. 


DEFINITION 2.2.5 
(a) A subset O of R is open if every point of O is an interior point of O. 


(b) A subset F of R is closed if F° =R\ F is open. 


Remark. From the definition of an interior point it should be clear that a set 
O C Ris open if and only if for every p € O there exists an € > 0 (depending on 
p) so that N.(p) C O. Both the definition of interior point and open depend 
on the metric of the given set. In situations where there is more than one 
metric defined on a given set, we will use the phrase open with respect to d to 
emphasize the metric. 


EXAMPLES 2.2.6 (a) The entire set R is open. For any p € R and € > 0, 
N.(p) C R. Since R is open, by definition the empty set @ is closed. However, 
the empty set is also open. Since @ contains no points at all, Definition 2.2.5(a) 
is vacuously satisfied. Consequently R is also closed. 


(b) Every e-neighborhood is open. Suppose p € R and € > 0. If g € Ne(p), 
then |p — q| < «. Choose 6 so that 0 < 6 < €— |p— ql. If a € No(q), then 


je—p| < lp—¢| + a—¢| 
<|p—q|+6<|p—q|+e-|p—a|=e. 


Therefore Ns(q) C N.-(p) (see Figure 2.3) Thus q is an interior point of N.(p). 
Since q € N.(p) was arbitrary, N.(p) is open. 
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NAP) 


p-€ Dp gq Dre 


FIGURE 2.3 
A delta neighborhood of q in Example 2.2.6(d) 


(c) Let E = (a,}], a < 6, be as in Example 2.2.4(a). Since the point b € E 
is not an interior point of E, the set E is not open. The complement of E is 
given by 

E® = (—o0, a] U (8, 00). 
An argument similar to the one given in Example 2.2.4(a) shows that a is not 


an interior point of E°. Thus E° is not open and hence by definition F is not 
closed. Hence F is neither open nor closed. 


(d) Let F = [a, 6], a < b. Then 
Fe= (—oo, a) U (b, 00), 


and this set is open. This can be proved directly, but also follows as a conse- 
quence of Theorem 2.2.9(a) below. 

(e) Consider the set Q. Since no point of Q is an interior point of Q 
(Example 2.2.4(b)), the set Q is not open. Also, Q is not closed. 


The use of the adjective open in describing the intervals (a, b), (a, 00), (—0oo, b) 
and (—oo, co) is justified by the following theorem: 


THEOREM 2.2.7 Every open interval in R is an open subset of R. 


Proof. Exercise 1. 


THEOREM 2.2.8 Every ¢-neighborhood is open. 


Proof. The proof is identical to the proof given in Example 2.2.6(b). 


THEOREM 2.2.9 Let (X,d) be a metric space. Then 

(a) for any collection {Oataca of open subsets of X, ye, Oa ts open, 
and 

(b) for any finite collection {O1,...,On} of open subsets of X, (pi O; is 


open. 
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Proof. The proof of (a) is left as an exercise (Exercise 2). 
(b) If \;_, O; = 0, we are done. Otherwise, suppose 


pEO=[)O;. 


j=l 


Then p € O;, for all i = 1,...,n. Since O; is open, there exists an €; > 0 such 
that 


Let ¢ = min{e,...,é.}. Then « > 0 and N.(p) C O; for all 2. Therefore 
N.(p) C O, ie., p is an interior point of O. Since p € O was arbitrary, O is 
open. 


For closed subsets we have the following analogue of the previous result. 


THEOREM 2.2.10 Let (X,d) be a metric space. Then 
(a) for any collection {Fa}aea of closed subsets of X, () 
and 
(b) for any finite collection {F\,..., Fn} of closed subsets of X, jan F; is 
closed. 


aca a ts closed, 


Proof. The proofs of (a) and (b) follow from the previous theorem and De- 
Morgan’s laws: 


n 


(0 rn) = Ur, |US ati 


acA acA j=l 


Remark. The fact that the intersection of a finite number of open sets is 
open is due to the fact that the minimum of a finite number of positive num- 
bers is positive. This guarantees the existence of an « > 0 such that the 
e-neighborhood of p is contained in the intersection. For an infinite number 
of open sets, the choice of a positive « may no longer be possible. This is 
illustrated by the following two examples. 


EXAMPLES 2.2.11 We now provide two examples to show that part (b) 
of Theorem 2.2.9 is in general false for a countable collection of open sets. 
Likewise, part (b) of Theorem 2.2.10 is in general also false for an arbitrary 
union of closed sets (Exercise 15). 


(a) For each n = 1,2,..., let On = (—+, +), Then each O, is open, but 


n=1 


which is not open. 
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(b) Alternately, if we let G, = (0,1+ 4), n =1,2,..., then again each G, 
is open, but 


() Gn = (0,1), 
n=1 


which is neither open, nor closed. 


Limit Points 


DEFINITION 2.2.12 Let E be a subset of a metric space X. 

(a) A point p € X is a limit point of E if every e-neighborhood N,(p) of 
p contains a pointq € E with q # p. 

(b) A point p € E that is not a limit point of E is called an isolated point 
of E. 


Remark. In the definition of limit point it is not required that p is a point of 
FE. Also, a point p € E is an isolated point of E if there exists an « > 0 such 
that N.(p)N E = {p}. 


EXAMPLES 2.2.13 (a) E = (a,b),a < b. Every point p,a <p <b,isa 
limit point of &. This follows from the fact that for any € > 0 there exists a 
point x € (a,b) satisfying p < « < p+e. These however are not the only limit 
points. Both a and 0b are limit points of E, but they do not belong to FE. 

(b) B= {4+:n=1,2,...}. Each + is an isolated point of E. If € is chosen 
so that 


1 1 i 

O<e< = ’ 

n(nt+1) n n+l 
Then N.(4+) = {4+}. Hence no point of E is a limit point of E. However, 0 is 
a limit point of EF which does not belong to EF. To see that 0 is a limit point, 
given € > 0 choose n € N so that 1/n < e. Such a choice of n is possible by 

Theorem 1.5.1. Then 1/n € N.(0)N £, and thus 0 is a limit point of FE. 

(c) Let FE = QN (0, 1). If p € [0, 1] then p is not a limit point of E. For if 
p > 1, then for « = $(p— 1) we have N.(p) MN E = 0. Likewise when p < 0. 
On the other hand, every p € [0,1] is a limit point of E. Let € > 0 be given. 
Suppose first that 0 < p< 1. Then by Theorem 1.5.2 there exists r € Q such 
that p <r < min{p+e,1}. When p = 1, Theorem 1.5.2 also guarantees the 
existence of an r € Q/M [0,1] with p—e <r < p. Thus for every € > 0, N-(p) 
contains a point r € F with r 4 p. The same argument also proves that every 
point of R is a limit point of Q. 


The following theorem provides a characterization of the closed subsets of 
a metric space (X, d). 


THEOREM 2.2.14 A subset F of a metric space X is closed if and only if 
F contains all its limit points. 
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Proof. Suppose F' is closed. Then by definition F’° is open and thus for every 
p € F° there exists « > 0 such that N-(p) C F*, that is, Ne(p) OF = @. 
Consequently no point of F° is a limit point of F’. Therefore F must contain 
all its limit points. 

Conversely, let F be a subset of X that contains all its limit points. To 
show F' is closed we must show F’° is open. Let p € F*. Since F contains all 
its limit points, p is not a limit point of F’. Thus there exists an « > 0 such 
that N.(p) 1 F = 0. Hence N.(p) C F° and p is an interior point of F'°. Since 
p € F° was arbitrary, F'° is open and therefore F' is closed. 


THEOREM 2.2.15 Let E be a subset of a metric space X. If p is a limit 
point of E, then every €-neighborhood of p contains infinitely many points of 
E. 


Proof. Suppose there exists an e-neighborhood of p that contains only finitely 
many points of E, say q1,---,Gn with q; 4 p. Let 


€=min{d(qj,p):i=1,...,n}. 


Then N,(p) contains at most p. Thus p is not a limit point of E. 


COROLLARY 2.2.16 A finite set has no limit points. 


Closure of a Set 


DEFINITION 2.2.17 If E is a subset of a metric space X, let E" denote 
the set of limit points of E. The closure of E’, denoted E is defined as 


E=EUE’. 


THEOREM 2.2.18 If E is a subset of a metric space X, then 
(a) E is closed. 
(b) E=BE if and only if E is closed. 
(c) EC F for every closed set F C X such that EC F. 


Proof. (a) To show that E is closed, we must show that E° is open. Let 
pe E’. Then p¢ EF and pis not a limit point of &. Thus there exists an € > 0 
such that 

N.(p) NE =9. 


We complete the proof by showing that N.(p)M E’ is also empty and thus 
N(p) NE =0. Therefore N.(p) C E", ie., p is an interior point of E*. 

Suppose N.(p) NE’ 4 0. Let q¢ € N-(p)N E’, and choose 6 > 0 such that 
Ns(q) C N-(p). Since q € E’, ¢ is a limit point of E and thus Ns(q)N E 4 0. 
But this implies that N.(p)M E 4 0, which is a contradiction. Therefore, 
N.(p) QE’ = @, which proves the result. 
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(b) If E = E, then E is closed. Conversely, if E is closed, then E’ C E 
and thus E = E. 


(c) If E C F and F is closed, then E’ c F. Thus Ec F. 


DEFINITION 2.2.19 A subset D of a metric space X is dense in X if 
=X, 


The rationals Q are dense in R. By Example 2.2.13(c), every point of R 
is a limit point of Q. Hence Q = R. This explains the comment following 
Theorem 1.5.2. The rationals are not only dense; they are also countable. The 
existence of countable dense subsets play a very important role in analysis. 
They allow us to approximate arbitrary elements in a set by elements chosen 
from a countable subset of R. Since the rationals are dense in R, given any 
p€Rande > 0, there exists r € Q such that |p—r| < e. Additional examples 
of this will occur elsewhere in the text. 


Characterization of the Open Subsets of R! 


If {7,,} is any finite or countable collection of open intervals, then by Theorem 
2.2.9, U = U,, In is an open subset of R. Conversely, every open subset of R 
can be expressed as a finite or countable union of open intervals (see Exercise 
22). However, a much stronger result is true. We now prove that every open 
set can be expressed as a finite or countable union of pairwise disjoint open 
intervals. A collection {I,,} of subsets of R is pairwise disjoint if I, In =9 
whenever n # m. 


THEOREM 2.2.20 If U is an open subset of R, then there exists a finite 
or countable collection {I,,} of pairwise disjoint open intervals such that 


=| ie 


Proof. Let x € I. Since U is open, there exists an € > 0 such that 
(w-—¢€,a+e) CU. 


In particular (s, xz] and [z,t) are subsets of U for some s < x and some t > a. 
Define rz and |, as follows: 


ry =sup{t: t >a and [x,t) CU}, and 
l, =inf{s: s <a and (s,a] CU}. 


Then x < ry < co and —co < 1, < a. For each x € U, let I, = (lye, rz). Then 
(a) I, CU, 


1This topic can be omitted upon first reading of the text. The structure of open sets will 
only be required in Chapter 10 in defining the measure of an open subset of R. 
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(b) If x, y € U, then either J, = I, or I, NI, = 9. 
The proofs of (a) and (b) are left as exercises (Exercise 21). 

To complete the proof, we let Z = {I, : « € U}. For each interval I € T, 
choose r7 € Q such that r; € I. If J, J € ZT are distinct intervals, then ry 4 r;. 
Therefore the mapping J > r; is a one-to-one mapping of Z into Q. Thus the 
collection Z is at most countable and therefore can be enumerated as {J;}je, 
where A is either a finite subset of N, or A =N. Clearly 


ea Ww ee 
jEA 


and by (b), ifn 4 j, then I, 11; =. Thus the collection {J;}j;¢4 is pairwise 
disjoint. 


Relatively Open and Closed Sets 


One of the reasons for studying topological concepts is to enable us to study 
properties of continuous functions. In most instances, the domain of a function 
is not all of R but rather a proper subset of R as is the case with f(x) = \/z for 
which Dom f = [0,00). When discussing a particular function we will always 
restrict our attention to the domain of the function rather than all of R. With 
this in mind we make the following definition. 


DEFINITION 2.2.21 Let Y be a subset of a metric space X. 

(a) A subset U of Y is open in (or open relative to) Y if for every p € U, 
there exists € > 0 such that N-(p) AY CU. 

(b) A subset C of Y is closed in (or closed relative to) Y if Y\C is open 
ny. 


EXAMPLE 2.2.22 Let X = [0,00) and let U = [0,1). Then U is not open 
in R but is open in X. (Why?) 


The following theorem, the proof of which is left as an exercise (Exercise 
24), provides a simple characterization of what it means for a set to be open 
or closed in a subset of X. 


THEOREM 2.2.23 Let Y be a subset of a metric space X. 

(a) A subset U of Y is open in Y if and only if U =Y NO for some open 
subset O of X. 

(b) A subset C of Y is closed in Y if and only if C = YF for some 
closed subset F of X. 
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Connected Sets? 


Our final topic of this section involves the notion of a connected set. The idea 
of connectedness is just one more of the many mathematical concepts which 
have their roots in the studies of Cantor on the structure of subsets of R. When 
we use the term connected subset of R, intuitively we are inclined to think of 
an interval as opposed to sets such as the positive integers N or (0,1) U {2}. 
We make this precise with the following definition. 


DEFINITION 2.2.24 A subset A of a metric space X is connected if 
there do not exist two disjoint open sets U and V such that 


(a) ANU 40 and ANV ¥9, and 
(b) (ANU)U(ANV) =A. 


The definition for a connected set differs from most definitions in that it 
defines connectedness by negation; i.e., defining what it means for a set not 
to be connected. According to the definition, a set A is not connected if there 
exist disjoint open sets U and V satisfying both (a) and (b). As an example of 
a subset of R which is not connected, consider the set of positive integers N. 
If we let U = (5,3) and V = (3,00), then U and V are disjoint open subsets 
of R with 

UNN={1} and VON = {2,3,....} 
that also satisfy (UN N)U(V ON) =N. That the interval (a,b) is connected 


is a consequence of the following theorem, the proof of which is left to the 
exercises (Exercise 27). 


THEOREM 2.2.25 A subset of R is connected if and only if it is an interval. 


Exercises 2.2 


1. Prove Theorem 2.2.7. 
2. *Prove Theorem 2.2.9(a). 
3. *a Show that every finite subset of R is closed. 
b. Show that the intervals (—oo, a] and [a, oo) are closed subsets of R. 


4. Let X be the metric space of Example 2.1.7(g). Let p = (3,0). Describe 
the e-neigborhoods of p for each of the following values of €: € = i €= 
1 3 
26 = 4: 


?This concept, although important and used implicitly in several instances in the text, 
will not be required specifically in subsequent chapters except in a few exercises. Thus the 
topic of connectedness can be omitted upon first reading of the text. 
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10. 


11. 


12. 


13. 


14. 
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For j = 1, 2, co, let dj denote the metrics given in Examples 2.1.7 (d) 
and (e). For each j and € > 0, let N/(p) denote the neighborhood of 
the point p € R?. 

a. For p = (0,0) and € = 1, sketch the «neighborhoods N/(p) for 
j =1, cw. 
*b. Prove that for « > 0, 
Ne(P) C N2(P) C Ne?(P) C N2.(P). 

c. Using the results of (b), prove that a set U is open with respect to 


one of the metrics di, d2,dx if and only if it is open with respect to the 
other two. 


If U and V are open subsets of R, prove that U x V is an open subset of 
R?. 

Consider the metric space (X,d) of Example 2.1.7(c). Prove that every 
subset of X is open. 


For the following subsets E of R, find each of the following: Int(F), E’, 
Isolated points of E, if any, and FE. Determine whether the set E is open, 
closed, or neither. 

*a. (0,1) U{2} b. (a,b) c. (a,b) *d. {= :n EN} e. QK(0, 1]. 


Let EF CR. A point p € R is a boundary point of EF if for every € > 0, 
N-(p) contains both points of E and points of E£°. Find the boundary 
points of each of the following sets, 


*a. (a,b) b. E={4:neN} c. N d. Q 
a. Prove that a set EC R is open if and only if E does not contain any 
of its boundary points. 


b. Prove that a set E C R is closed if and only if E contains all its 
boundary points. 


For each of the following subset E of R’, find Int(£) and EL. 

a. & = (1,2) x [-1,1] b. E={(z,y):-l<a<2,yeR} 
ce. E={(x,y): y=} d. E={(x,y):y<satl} 

e. E = {p € R? :0 < da(p,0) < 1} 


a. Construct a set with exactly two limit points. 

b. Find an infinite subset of R with no limit points. 

c. Construct a countable subset of R with countably many limit points. 
d. Find a countable subset of R with uncountably many limit points. 


Let X = (0,00). For each of the following subsets of X determine whether 
the given set is open in X, closed in X, or neither. 


*a.(0,1]  b. (0,1) ~~ *e. (0,1JU (2,3). (0, 1] U {2} 


For each of the following subsets of Q, determine whether the set is open 
in Q, closed in Q, both open and closed in Q, or neither. 


a. A={pEeQ:1<p<2). bB={peEQ:2<p? <3}. «N. 
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15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 
25. 


26. 
27. 


a. Prove Theorem 2.2.10(a). 


b. Give an example of a countable collection {Fn}, of closed subsets 
of R such that U?_, Fn is not closed. 


*Let A be a nonempty subset of R that is bounded above, and let a = 
sup A. If a ¢ A, prove that a is a limit point of A 


Let (X,d) be a metric space, and E Cc X. 
*a. Prove that Int(£) is open. 
b. Prove that FE is open if and only if E = Int(£). 
c. If GC E and G is open, prove that GC Int (£). 
Let A, B be subsets of R. 
a. If A C B, show that Int(A) C Int(B). 
b. Show that Int(ANM B) = Int(A) NM Int(B). 
ce. Is Int(AU B) = Int(A) U Int(B)? 
d. Are the results of (a) and (b) still true if A and B are subsets of a 
metric space X ? 
Let A, B be subsets of a metric space X. 
*a. Show that (AU B) = AUB. 
b Show that AN BC ANB. 
c. Give an example for which the containment in (b) is proper. 
Let Do = {0,1}, and for each n €N, let 


Dn = {a/2":a€N, a is odd, 0<a< 2"}. Let D= U Dn. 
n=0 


Prove that D is a countable dense subset of [0, 1]. 
Prove statements (a) and (b) of Theorem 2.2.20. 


*Prove that there exists a countable collection Z of open intervals such 
that if U is an open subset of R, there exists a finite or countable collection 
{In} CZ with U =UIn. 


*If U is an open subset of R, prove that E C U is open in U if and only 
if FE is an open subset of R. 


Prove Theorem 2.2.23. 


For each of the following, use the definition to prove that the given set is 
not connected. 


*a.(0,1)U{2} b.{+:n=1,2,....} e {pe Q:p>0 and 1 <p? < 3}. 
*If A is connected, prove that A is connected. 


*Prove Theorem 2.2.25. 
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2.3. Compact Sets 


In this section, we introduce the concept of a compact set in the setting of 
metric spaces. A characterization of the compact subsets of R is provided in 
Section 2.4. The notion of a compact set is very important in the study of 
analysis, and many significant results in the text will depend on the fact that 
every closed and bounded interval in R is compact. The modern definition of 
a compact set given in 2.3.3 dates back to the second half of the nineteenth 
century and the studies of Heine and Borel on compact subsets of R. 


DEFINITION 2.3.1 Let E be a subset of a metric space (X,d). A collection 
{Oahaea of open subsets of X is an open cover of E if 


Ec |} Q,. 


acA 


An alternate definition is as follows: The collection {Og}aea of open sets 
is an open cover of FE if for each p € FE, there exists an a € A such that 
pe Oa. 


EXAMPLES 2.3.2 (a) Let E = (0,1) and O, = (0,1 — +), n = 2,8,.... 
Then {O,,}°°, is an open cover of E. To see this, suppose 7 € E. Then since 
x <1, there exists an integer n such that « < 1—1/n. Thus x € Oy, and as 
a consequence 
BC |) O., 
n=2 

which proves the assertion. In fact, since O, C F for each n, we have EF = 
Un=2 On. 

(b) Let F = (0,00) and for each n € N let U, = (—1,n). Then {Un} nen 
is an open cover of F’. 


DEFINITION 2.3.3 A subset kK of X is compact if every open cover of 
K has a finite subcover of K; that is, if {Oa}aea is an open cover of K, then 
there exists Q1,...,@, € A such that 
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EXAMPLES 2.3.4 (a) Every finite set is compact. Suppose E = 
{pi,.--;Pn} is a finite subset of R and {Og}aca is an open cover of E. Then 
for each j, 7 = 1,...,n, there exists a; € A such that p; € Og,. But then 
{Oa, }7=1 is a finite sub-collection which covers EF. 

(b) The open interval (0,1) is not compact. For the open cover {O,,}°2»5 
of (0,1) in Example 2.3.2(a), no finite sub-collection can cover (0,1). Suppose 
on the contrary that a finite number, say On,,...,On,, cover (0,1). Let N = 
max{ny,...,Nx}. Then 


k N 
(0,1) < LJ On, ¢ LJ On = (0,1- H), 
j=l n 


=2 


which is a contradiction. 


(c) The closed set F = [0,0o) is not compact. For the open cover U = 
{(—1,)}nen of F, no finite sub-collection can cover F’. If there exist a finite 
number of sets in YU which cover F’, then there exists N € N such that F C 
(—1, NV). (Why?) This however is a contradiction. 


Properties of Compact Sets 


Before we provide a characterization of the compact subsets of R, we first 
prove several properties of compact sets that require only the definition of 
compactness. As a consequence, all three of the following theorems are true in 
more general settings; e.g. in n—dimensional space R” as well as in a general 
metric space (X, d). 


THEOREM 2.3.5 
(a) Every compact subset of a metric space is closed. 


(b) Every closed subset of a compact set is compact. 


Proof. (a) To show that K is closed, we need to show that A is open. Let 
p € K° be arbitrary. For each q € K, choose €g > 0 such that 


Ne, (q)n N.,(P) = 0. 


Any €q satisfying 0 < €, < sd(p, q) will work. Then {N.,(q)}qex is an open 
cover of kK. Since K is compact, there exists q1,...,@n Such that 


n 


KCUN.,, (a). 


j=l 
Let € = min{e,, : j = 1,...,n}, which is positive. Then 


Ne(p) Neg, (43) =0 — for all j =1,...,n. 
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Thus N.(p)N K = 0, ie., N-(p) C K°. Therefore p is an interior point of K°¢ 
and thus K° is open. 

(b) Let F be a closed subset of the compact set K and let {Oa}aea be an 
open cover of F’. Then 


{Oahaea U {F°} 


is an open cover of kK. Since K is compact, a finite number of these will cover 
K, and hence also F. 


COROLLARY 2.3.6 If F is closed and K is compact, then FM K is com- 
pact. 


As a consequence of the previous theorem, the open interval (0,1) is not 
compact since it is not closed. However, being closed is not sufficient for a set 
to be compact. The half-open interval [0,co) is closed in R, but as shown in 
Example 2.3.4(c) is not compact. In Theorem 2.4.2 we will provide necessary 
and sufficient conditions for a subset of R to be compact. 


Remark. In proving that the compact set K was closed, compactness allowed 
us to select a finite subcover from the constructed open cover of AK. Finiteness 
then assured that the € as defined was positive. This method of first construct- 
ing an open cover possessing certain properties and then using compactness 
to assure the existence of a finite subcover will be used on other occasions in 
the text. 


THEOREM 2.3.7 If E is an infinite subset of a compact set K, then E has 
a limit point in K. 


Proof. If no point of K is a limit point of F, then for each q € K, there exists 
a neighborhood N, of g so that Ng contains at most one point of #, namely 
q if q € E. Since E is infinite, no finite sub-collection of {Ng}gex can cover 
E, and consequently no finite sub-collection of {Ng}gex can cover K, which 
is a contradiction. 


Another useful consequence of compactness is the following analogue of 
what is known as the nested intervals property (see Exercise 3 of Section 2.4). 


THEOREM 2.3.8 If {K,,}°2, is a sequence of nonempty compact subsets 
of X with Ky, D> Ky41 for all n, then 


K= Q Ky 
n=1 


is nonempty and compact. 
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Proof. We first show that (7, Kn # 0. Let O, = K¢. By Theorem 2.3.5 
K,, is closed and thus O, is open. Furthermore, 


q K, =@ if and only if Jo. =x. 
n=1 n=1 


Thus if (~~, K, = 90, then {O,,}°2, is an open cover of X, and thus also of 
K,. But K, is compact. Therefore there exists n1 <--- <n, such that 


k 
Kye U On;- 


j=l 


But then Ky Kn, N---A Kn, = 0. This however is a contradiction, since 
the intersection is equal to K,,,, which by hypothesis is nonempty. Thus k = 
(\Kn #9. By Theorem 2.2.10 K is closed, and hence by Theorem 2.3.5(b), 
K is compact. 


Exercises 2.3 


ly Tet AS {etn S12). 
a. Show that the set A is not compact. 
*b. Prove directly (using the definition) that K = AU {0} is compact. 


2. Show that (0,1] is not compact by constructing an open cover of (0, 1] 
that does not have a finite subcover. 


3. Suppose A and B are compact subsets of a metric space X. 
*a. Prove (using only the definition) that AU B is compact. 
b. Prove that AM B is compact. 


4. *Let K be a nonempty compact subset of R. Prove that sup K and inf K 
exist and are in K. 


5. Construct a compact subset kK of R with an infinite number of isolated 
points. Justify that your set K is compact. 


6. Suppose K is an infinite compact subset of a metric space (X,d). Prove 
that there exists a countable subset D of K such that D = K. 


2.4 Compact Subsets of R 


We now turn to our goal of providing a characterization of the compact sub- 
sets of the real line R. The first of the two main results is attributed to Eduard 
Heine (1821-1881) and Emile Borel (1871-1956), whereas the second is due 
to Bernhard Bolzano (1781-1848) and Karl Weierstrass (1815-1897). The two 
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theorems rank very high among the many important advances in the foun- 
dations of analysis during the nineteenth century. The importance of these 
results will become evident in later chapters. As is to be expected, the least 
upper bound property of R will play a crucial role in the proofs of these 
theorems. 


THEOREM 2.4.1 (Heine-Borel) Every closed and bounded interval {a, b] 


is compact. 
Proof. Let U = {Ua}aea be an open cover of [a,b] and let 
E = {r € [a, | : [a,r] is covered by a finite number of the sets U,}. 


The set F is bounded above by b, and since a € U, for some a € A, E is 
nonempty. Thus by the least upper bound property the supremum of EF exists 
in R. Let a = sup E. Since 6 is an upper bound of E, a < b. 

We first show that a € E, ie., [a,a] is covered by a finite number of sets 
in U. Since a € [a,b], a € Ug for some 6 € A. Since Ug is open, there exists 
€ > 0 such that (a —€,a+e) C Ug. Furthermore, since a — € is not an upper 
bound of EF, there exists r € E such that a—¢€ < r < a. But then [a,r] is 
covered by a finite number, say Ug,,...,Ua,,, of sets in U. But then the finite 
collection {U,,,...,Ua,,,Ug} covers [a,a]. Therefore, a € E. 

To conclude the proof we show that a = b. Suppose a < b. If we choose 
s < b such that a < s < a+e, then the collection {Ua,,...,Ua,,Ug} also 
covers [a,s]. Thus s € E which contradicts that a = sup E. Hence a must 
equal b. 


The statement of the Heine-Borel theorem was initially due to Heine, a 
student of Weierstrass, who used the result implicitly in the 1870s in his 
studies on continuous functions. The theorem was proved by Borel in 1894 
for the case where the open cover was countable. For an arbitrary open cover 
the result was finally proved in 1904 by Henri Lebesgue (1875-1941). Using 
the Heine-Borel theorem we now prove the following characterization of the 
compact subsets of R. 


THEOREM 2.4.2 (Heine-Borel-Bolzano-Weierstrass) Let K be a sub- 
set of R. Then the following are equivalent: 


(a) K is closed and bounded. 
(b) K is compact. 
(c) Every infinite subset of K has a limit point in K. 


Remark. A subset EF of R is bounded if it is bounded both above and below, 
i.e., there exists a constant M such that |z| < M for all x in E. 
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Proof. (a) = (b). Since K is bounded, there exists a positive constant M so 
that K Cc [—M, M]. Since [—M, M] is compact and K is closed, by Theorem 
2.3.5(b) K is compact. 

(b) > (c). This is Theorem 2.3.7. 


(c) = (a). Suppose the set K is not bounded. Then for every n € N there 
exists pn € K with pn, 4 pm for n 4 m such that |p,| > n for all n. Then 
{pn in =1,2,...} is an infinite subset of R with no limit point in R, and hence 
none in K, which is a contradiction. Thus K is bounded. 


Let p be a limit point of kK. By definition of limit point, for each n € N 
there exist pn € K with p, 4 p such that 


1 
\Pn — p| <-. 
nr 


Then S$ = {p, :n =1,2,...} is an infinite subset of K, and p is a limit point 
of S. To complete the proof we must show that p is the only limit point of S, 
and hence by hypothesis must be in K, i.e., K is closed. 


Suppose q € R with q 4 p. Let « = $|p — q| and choose N € N such that 
1/N <e. Then for alln > N 


1 
Ip— al S |Pn — | + [Pn — PI < [Pn — al + ~ < [pn — al +. 
Therefore, for alln > N, 
lpn — @| > |p—a|-—€ = §lp—4l. 


Thus N.(q) contains at most finitely many p,,, and as a consequence q cannot 
be a limit point of S. Therefore no q € R with q £ pis a limit point of S. 


Statement (c) of the previous theorem is basically what is referred to as 
the Bolzano- Weierstrass theorem, which we state for completeness. The proof 
of the result follows immediately from Theorems 2.3.7 and 2.4.2. 


THEOREM 2.4.3 (Bolzano-Weierstrass) Every bounded infinite subset 
of R has a limit point. 


The theorem was originally proved by Bolzano, and modified slighly in 
the 1860s by Weierstrass. This result can also be proved directly using the 
nested interval property (Exercise 7). Although we restricted ourselves to R, 
the analogous statement of Theorem 2.4.2 is also true in R”. The proof of the 
following theorem, for n = 2, is left as an exercise. The proof for n > 2 is 
identical to the case n = 2. 


THEOREM 2.4.4 A subset E of R” is compact if and only if E is closed 
and bounded. 
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As in the Remark following Theorem 2.4.2, a subset E of R” is bounded 
if and only if there exists a positive constant M such that d2(p,0) < M for 
all p € E. This is equivalent to 


lpi] < M, t=1,...,n 
for all p = (p1,.--,;Pn) € E. 


Exercises 2.4 


1. * Find a countable collection {Kn}? of compact subsets of R such that 
Uee_, Kn is not compact. 


2. a. Suppose J and J are closed and bounded intervals in R. Prove that 
I x J is a compact subset of R?. 


b. Prove that a subset E of R? is compact if and only if it is closed and 
bounded. 


3. *(Nested Intervals Property) Let {In} be a countable family of 
nonempty closed and bounded intervals satisfying I, D In+1 for all n. 
Prove that there exists a < 6 in R such that 


Piae= eal. 


4. Let d denote the usual metric on R and let p be the metric on R given 
by 


lz — yl 
LY) => 
p(x, y) reload 


a. Prove that a subset of R is open with respect to the metric d if and 
only if it is open with respect to p. 


b. Show that [0, 00) is closed and bounded in the metric p but that [0, 00) 
is not a compact subset of the metric space (R, p). 


5. Let X = Q with metric d(p,q) = |p—q|. Let E={p €Q: p> 0,p’ < 2}. 
Show that E is closed and bounded in Q, but not compact. 


6. This exercise outlines an alternate proof of the Heine-Borel Theorem. 
Suppose [a,b] is not compact. Then there exists an open cover U = 
{Uahaea of [a,b] such that no finite sub-collection of U covers [a,b]. We 
now proceed to show that this leads to a contradiction. Divide [a, b] into 
two closed subintervals [a, “t°] and [**,b] each of length (b—a)/2. At 
least one of these, call it J; cannot be covered by a finite number of the 
U,,. Repeating this process obtain a sequence {J,,} of closed and bounded 
intervals satisfying (a) [a,b] D Ii D I2 D--- D In D---, (b) length of 
I, = (b—a)/2”, and (c) for each n, I, is not covered by a finite number 
of the U,. Now use Exercise 3 to obtain a contradiction. 


7. Prove the Bolzano-Weierstrass Theorem using the nested intervals prop- 
erty. 


Topology of the Real Line 77 


2.5 The Cantor Set 


In this section, we will construct a compact subset of [0,1], known as the 
Cantor set, that has a number of interesting properties. This set is constructed 
by induction, the first two stages of which are illustrated in Figure 2.4. 


Let Pp = [0, 1]. From Py remove the middle third open interval ee 2). This 

leaves two disjoint closed intervals 
Ji4 = (0, | ’ Ji2 = [Z, 1] : 

Set Py => Ji U Ji 9. 

From each of J;,; and Jj,2 remove the middle third open intervals 

(ge,gz) and = (3, 3x) 

of length 3: This leaves 2? disjoint closed intervals Jo1, Jo,2, J2,3, Joa of 
length 4+; namely 


32) 
[0,37], [gz,az],  [geege], [aes ae] - 


Set Py = Jo1 U Jo2U Jo.3 U Jo,4. In Figure 2.4, the shaded intervals indicate 
the open intervals that are removed at each stage of the construction. 


Jia 1,2 
Jon J22 i 
vi wee ee eas 
FIGURE 2.4 


Construction of the Cantor set 


We continue this process inductively. At the nth step, each P,, is the union 
of 2” disjoint closed intervals each of length 1/3”, i.e., 


gr 
P= U Inj 
j=l 


where for each j, Jn; is a closed interval of the form 


= x5 Xj + 1 
Ini . 3n | 
Since each P,, is a finite union of closed intervals, P,, is closed and bounded, 
hence compact. Furthermore, since P, > P; > P2 D---, by Theorem 2.3.8, 


P= q Py 
n=0 


78 Introduction to Real Analysis 


is anonempty compact subset of [0, 1]. The set P is called the Cantor ternary 
set. 


We now consider some of the properties of the set P. 
Property 1  P is compact and nonempty. 
Property 2  P contains all the endpoints of the closed intervals {Jn,x}, 
= 1, Bysiny Ay De ces BM 
Property 3 Every point of P is a limit point of P. 


Proof. Let p € P and let « > 0 be given. Choose m € N such that 1/3” < e. 
Since p € Pn, p € Jm,x for some k, 1 << k < 2”. But 


i E Lp | 


3m? 3m 


Since length of Jm,~ = 1/3 < €, Im,nr C N-(p). Thus both endpoints of Jm,x 
are in PM N.(p), and at least one of these is distinct from p. 


Property 4 The sum of the lengths of the intervals removed is 1. 
Proof. At step 1, we removed one interval of length 1/3. At the second step, 
we removed two intervals of length 1/37. At the nth step, to obtain P,, we 
removed 2”~' intervals of length 1/3”. Thus we obtain that 


1 1 
Sum of the lengths of the intervals removed = 3 233 beve pont a 
So 1582) 
n=1 a 3 n=0 3 
1 1 
aoe z = ic 
a oe 


As a consequence of Property 4, 
Property 5 P contains no intervals. 
For x € [0,1] let x = .nyngn3... be the ternary expansion. As we indicated 


in Section 1.6, this expansion is unique except when 


a 
zr=—, aE€N with 0<a< 3”, 
3” 


where 3 does not divide a. In this case x has two expansions: a finite expansion 


ay a 
Fe tie 2 11,2) 
and an infinite expansion. If a,, = 2, we will use the finite expansion. If 


Gm = 1, we will use the infinite expansion 


ay 0 = 2 
Ra eet S- aE 
k=m+1 
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With this convention we have 


Property 6 If for each x € [0,1], v = .nyngn3.... is the ternary expansion 
of x, then 
x€P  ifandonlyif ng € {0,2}. 


Proof. Exercise 2. 


As a consequence of Property 6 and Theorem 1.7.18, 
Property 7 P is uncountable. 


For each n, the set P, has only a finite number of endpoints. As a con- 
sequence, the set of points of P which are endpoints of some open interval 
removed in the construction is countable. Since P is uncountable, P contains 
points other than endpoints. By Exercise 1 of Section 1.6, the ternary expan- 
sion of + is 

1 
<7 .020202..... 


Thus + € P, but + is not an endpoint of P. 


Remark. By Property 4, the sum of the lengths of the intervals removed is 1. 
This seems to imply that P is in some sense very “small.” On the other hand, 
by Property 7 P is uncountable, which seems to imply that P is “large.” 


Exercises 2.5 


1. Determine whether + is in the Cantor set. 


13 
2. Prove Property 6 of the Cantor set. 
3. Let 0 <a <1. Construct a closed subset F of [0,1] in a manner similar 


to the construction of the Cantor set such that the sum of the lengths of 
all the intervals removed is a. 


4. *Prove that the Cantor set P is equivalent to [0, 1]. 


Notes 


Without a doubt, the most important concept of this chapter is compactness. The 
fact that every open cover of a compact set has a finite subcover will be crucial in 
the study of continuous functions, especially uniform continuity. As we will see in 
many instances, the applications of compactness depend on the ability to choose a 
finite subcover from a particular open cover. A good example of this is the proof of 
Theorem 2.3.5. Other instances will occur later in the text. 

Since compactness is the most important concept, Theorems 2.4.1 and 2.4.2 
are the two most important results. In the Heine-Borel theorem we proved that 
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every closed and bounded interval is compact, whereas in the Heine-Borel-Bolzano- 
Weierstrass theorem we characterized the compact subsets of R. In Theorem 2.3.7 
we proved that if K is a compact set then every infinite subset of K has a limit point 
in K. The converse of this result is also true, not only in R (Theorem 2.4.3), but 
also in the more general setting of metric spaces. A proof of this important result is 
outlined in the Miscellaneous Exercises. 


ee 
Miscellaneous Exercises 


The first two exercises involve the geometric and euclidean metric structure of R”. 
Forn > 2, R® = {(a1,...,0n) : v € Rit = 1,...,n}. For p = (pi,...,pn),q = 
(1, ---)Qn) in R” andceER, define 


p+q=(pit%,-;P~n +n), and 
cp = (cpi, -.-,CPn)- 


Also, let 0 = (0,...,0). For p,q € R”, the inner product of p and q, denoted 
(p,q), 1s defined as 
(p,q) = pigi +++ + Pndn- 


1. Prove each of the following: for p,q,r € R”, 
a. (p, p) > 0 with equality if and only if p = 0. 
b. (p,q) = (4, Pp). 
c. (ap + bq,r) = a(p,r) + b(q,r) for all a,bE R. 
d. |(p,q)| < V/(P, P) (a, 4). 
This last inequality is usually called the Cauchy-Schwarz inequality. 
As a hint on how to prove (d), for X € R, expand (p — Aq, p — Aq) and 


then choose X appropriately. Note that by (a), (p — Aq,p — Aq) > 0 for 
all A ER. 

2. For p = (p1,..-,pn) € R", set |lpll2 = (p,p) = Vpi+--:+p2. The 
quantity ||p||2 is called the norm or the euclidean length of the vector 
p. 
a. Use the result of 1(d) to prove that ||p + qll2 < ||pll2 + |lqll2 for all 
p,q € R”. 
b. Using the result of (a), prove that d2(p,q) = ||p — q|l2 is a metric on 
R”. 

3. If Eis an uncountable subset of R, prove that some point of EF is a limit 
point of EF. 


The following exercise is designed to prove the converse of Theorem 2.3.7; 
namely, if K is a subset of a metric space (X,d) having the property that 
every infinite subset of K has a limit point in K, then K is compact. 


Miscellaneous Exercises 


4. 
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Let K be a subset of a metric space (X,d) that has the property that 
every infinite subset of K has a limit point in Kk. 


a. Prove that there exists a countable subset D of K which is dense 
in K. (Hint: Fix n € N. Let p, € K be arbitrary. Choose po € K, if 
possible, such that d(pi,p2) > 2, Suppose p1,...,p; have been chosen. 
Choose p;+1, if possible, such that d(p1,pj;+1) > + for alli = 1,...,n. Use 
the assumption about K to prove that this process must terminate after 
a finite number of steps. Let P, denote this finite collection of points, 


and let D=U,,¢7 Pn. Prove that D is countable and dense in K.) 

b. Let D be as in (a), and let U be an open subset of X such that UNK # 
0. Prove that there exists p € D and n € N such that Nj/,(p) C U. 

c. Using the result of (b), prove that for every open cover U of K, there 
exists a finite or countable collection {Un}n CU such that K C U,, Un. 
d. Prove that every countable open cover of K has a finite subcover. 
(Hint: If {Un}7%21 is a countable open cover of K, for each n € N let 
Wr = j= U;. Prove that kK C W,, for some n € N. Assume that the 
result is false, and obtain an infinite subset of K with no limit point in 


K which is contradiction.) 
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Sequences of Real Numbers 


Now that we have covered the basic topological concepts required for the study 
of analysis, we begin with limits of sequences. This topic will be our first serious 
introduction to the limit process. The notion of convergence of a sequence 
dates back to the early nineteenth century and the work of Bolzano (1817) 
and Cauchy (1821). Some of the concepts and results included in this chapter 
have undoubtedly been encountered previously in the study of calculus. Our 
presentation however will be considerably more rigorous—emphasizing proofs 
rather than computations. 

Although our primary emphasis will be on sequences of real numbers, 
these are not the only sequences which are typically encountered. It is not 
at all unusual to talk about sequences of functions, sequences of vectors, etc. 
For this reason we will begin our study of sequences in the general setting of 
metric spaces. Most of the examples however will come from the real numbers. 
A good understanding of sequences in R will prove helpful in providing insight 
into properties of sequences in more general settings. 

We begin the chapter by introducing the notion of convergence of a se- 
quence in a metric space, and then by proving the standard limit theorems 
for sequences of real numbers normally encountered in calculus. In Section 
3.3 we will use the least upper bound property of R to prove that every 
bounded monotone sequence of real numbers converges in R. The study of 
subsequences and sub-sequential limits will be the topic of Section 3.4. In this 
section, we also prove the well known result of Bolzano and Weierstrass that 
every bounded sequence of real numbers has a convergent subsequence. This 
result will then be used to provide a short proof of the fact that every Cauchy 
sequence of real numbers converges. Although the study of series of real num- 
bers is the main topic of Chapter 7, some knowledge of series will be required 
in the construction of certain examples in Chapters 4 and 6. For this reason 
we include a brief introduction to series as the last section of this chapter. 


3.1 Convergent Sequences 


We begin our study of sequences by first considering sequences in arbitrary 
metric spaces. Throughout this section we let (X,d) be a metric space. When 
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X = R, unless otherwise specified d will denote the usual euclidean metric 
on R. Recall that by a sequence in X we mean a function f : N— X. For 
each n € N, pn = f(n) is called the nth term of the sequence f, and for 
convenience, the sequence f is denoted by {p,}°°,, or simply {py}. 


DEFINITION 3.1.1 A sequence {pn}, in X is said to converge if there 
exists a point p © X such that for every « > 0, there exists a positive integer 
No = No(e) such that pn € N-(p) for all n > no. If this is the case, we say 
that {p,} converges to p, or that p is the limit of the sequence {p,}, and 
we write 

lim pyp=p or PnP. 

noo 


If {pn} does not converge, then {pn} is said to diverge. 


In the definition, the statement p,, € N.(p) for all n > no is equivalent to 
A(pn,p)<e forall n> no. 


As a general rule, the integer n, will depend on the given e. This will be 
illustrated in the following examples. 


EXAMPLES 3.1.2 (a) For our first example we show that the sequence 
{1/n}°<, converges to 0 in R. The proof of this is the remark following The- 
orem 1.5.1; namely, given € > 0, there exists a positive integer n, such that 
No€ > 1. Thus for all n > no, 


Therefore lim 4 = 0. In this example, the integer n, must be chosen so that 
noo 
No > 1/e. 


(b) If p € R, the sequence {p,,} defined by p,, = p for all n € N is called the 
constant sequence p. Since |p, — p| = 0 for alln € N, we have lim p, = p. 
noo 


2 LL 1 Co 
(c) Consider the sequence { 7 5} . We will show that 
n+ 


n=1 


Since 
a2n+1 2] | 1 1 


3n +2 3|  3(8n+2) ~ On’ 


given € > 0, choose no € N such that no > x. Then for all n > no, 


38n+2 3 A 


2n+1 | 
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Thus the given sequence converges to 2/3. 

(d) The sequence {1 — (—1)"}°2, diverges in R. To prove this, we first 
note that for this sequence, |~pn —Pn4i| = 2 for all n. Suppose p, — p for some 
p ER. Let 0 < € < 1. Then by the definition of convergence, there exists an 
integer n, such that |p, — p| < € for alln > no. But ifn > no, then 


2= [Pn — Pn+1| < \Pn — P| + |p — Pn+i| < 26 < 2, 


which is a contradiction. 


(e) Consider the sequence 
Sy ee 
Be n’ 3n+2 
in R?. In Exercise 10 you will be asked to prove that a sequence py = (Pn; Qn) 


converges to p = (p,q) if and only if p, > p and q, — gq. Thus the above 
sequence converges to (1, 2). 


(f) Let X denote the set of bounded functions on [0,1] with metric d 
given by d(f,g) = sup{| f(x) — g(x)| : x € [0,1]}. Consider the sequence { f;, }, 
where for each n € N, f, is the function given by f,(x) = 2”/n. If f = 0 
denotes the zero function on [0,1], ic., f(a) = 0 for all x € [0,1], then for 
each n EN, 


(fn, f) = dfn; 9) =o {= :re oa} = 


As a consequence the sequence { f,,} converges to the zero function in X. 


DEFINITION 3.1.3 A sequence {p,} in X is said to be bounded if there 
exists p € X and a positive constant M such that d(p,pn) < M for alln EN. 


Remark. A sequence {p,,} in R is bounded if there exists a positive constant 
C such that |p,| < C for all n € N. To see this, suppose {p,} is bounded 
according to Definition 3.1.3. Then there exists p € R such that |p, — p| < M 
for all n. As a consequence 


IPn| < lpn — p| + [pl < (M + IpI), 


which proves the results. Thus with respect to the usual metric a sequence 
{pn} is bounded if and only if the set {p, :n = 1,2,...} is a bounded subset 
of R. This however is not always the case for other metrics (see Example 
3.1.5(c)). 


THEOREM 3.1.4 Let (X,d) be a metric space. 


(a) If a sequence {pn} in X converges, then its limit is unique. 
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(b) Every convergent sequence in X is bounded. 


(c) [fE CX andp is a limit point of E, then there exists a sequence {pp} 
in E with pn # p for all n such that 


lim py, = p. 

noo 
Proof. (a) Suppose the sequence {p,,} converges to two distinct points p, q € 
X. Let € = $d(p,q). Since pn — p, there exists an integer n; such that 
d(pn,p) < € for all n > ny. Also, since p, — q, there exists an integer nz such 
that d(pn,q) < ¢€ for all n > no. Thus if n > max{nj,n2}, by the triangle 
inequality 

d(p, 4) < d(Pn,p) + d(Pn,q) < 2€ = Zd(p,q) 

which is a contradiction. 


(b) Let {p,} be a convergent sequence in X that converges to p € X. Take 
€ = 1. For this ¢, there exists an integer n, such that d(pn,p) < 1 for all 
n> No. Let 

M= max{d(p, p1), sang d(P, Pno)s i i. 


Then d(p, py) < M for alln € N. Therefore the sequence is bounded. 


(c) We construct the sequence {p,,} in E as follows: Since p is a limit point 
of E, for each positive integer n, by the definition of limit point, there exists 
Pn € E with p, 4 p, such that 


d(Pn,p) < 


Sle 


This sequence clearly satisfies pp, — p. 


EXAMPLES 3.1.5 (a) According to the previous theorem, every con- 
vergent sequence is bounded. The converse however is false. The sequence 
{1 — (-1)"}°2, is bounded, but by Example 3.1.2(d), the sequence does not 
converge. The sequence is bounded since |p,| = |1—(—1)”| < 2 for alln EN. 


(b) The sequence {n(—1)”} is not bounded in R, and thus cannot converge. 


(c) Let X =R with the metric 


lz —y| 


£,y) = ——. 
p(x, y) aren 


With this metric every sequence {p,,} in R satisfies p(p,,p) < 1 for any p€ R. 
Thus every sequence {p,} in (R, p) is bounded according to Definition 3.1.3. 
Obviously however there exist sequences in R for which the range is not a 
bounded subset of R. It is interesting to note that a sequence {p,,} converges 
to p in the usual metric if and only if p, — p in the metric p (Exercise 11). 
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(d) In this example, we illustrate part (c) of the previous theorem. Since 
2 is a limit point of Q, the previous theorem guarantees the existence of 
a sequence {r,} of rational numbers such that r, — V2. Note however that 
this sequence need not be unique. If r, > V2, then the same is true for the 
sequence {r, + +}. 


Exercises 3.1 


1. For each of the following sequences, prove, using an €, no argument that 
the sequence converges to the given limit p; that is, given e > 0 determine 
No such that |pn — p| < € for alln > no. 


_ 3n +5 3 p, f2nt5 ol 

a a a ‘enaay 4 
n+] 1 (-1)" 

* =~ re aie =1 

ed ee {1- Ch 
om p=0. *f. {Vn +1—J/n},p=0 
n2+1 ? ? 


e {a(yitt-t)} v=} 


2. Show that each of the following sequences diverge in R. 
1 
*a.{n(1+(-1)")}. b. {0 4. a *e, {sin ah. 
d. {nsin “th. e. oa) ‘ 
2 n+1 
3. Ifb>0, prove that lim 


4. Prove each of the following. 


1 
*a. If b> 1, prove that lim — =0. 
n—oo hb” 


b. If0 <b <1, prove that lim 6” = 0. 


n—->oco 


5. *Let {an} be a sequence in R with lim ay, = a. Prove that lim a? =a’. 


n—-oco n—-oco 


6. *Ifa, > 0 for all n and lim ay =a, prove that lim /an = Ja. 
Rn+co 


n—->oco 


7. Prove that if {an} converges to a, then {|an|} converges to |a|. Is the 
converse true? 


8. *Let {an} be a sequence in R with lim ay = a. If a > 0, prove that 


noo 


there exists no € N such that an > 0 for all n > no. 


9. Let {an} be a sequence in R satisfying jan — an+1| > c for some c > 0 
and all n € N. Prove that the sequence {a,,} diverges. 

10. Consider R? with the metric dz as defined in Example 2.1.7(d). Suppose 
Pn = (Gn, bn) and p = (a,b). Prove that 
lm pn=p ifandonlyif lim an=aand lim db, =b. 
noo noo noo 

11. Consider R with the usual metric, and also with the metric 


|x — yl 
x,y) = ———_.. 
p(x, y) Teal 
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Prove that a sequence {p,} in R converges to p € R in the usual metric 
if and only if pn — p in the metric p. 

12. Let X be the set of bounded functions on [0, 1] with metric d as defined in 
Example 3.1.2(f). Prove that each of the following sequences of functions 
converges to the indicated functions f. 


hs oo £ 
a.4rv+—sinnx 
n 


“fle =a. b. (Gat (b> 1), f(x) =0. 


c. ima} f@=o. 


n= 


13. Let (X,d) be as in the previous exercise. Does the sequence {x”} converge 
in (X,d)? 


3.2 Sequences of Real Numbers 


In this section, we will emphasize some of the important properties of se- 
quences of real numbers, and also investigate the limits of several basic se- 
quences that are frequently encountered in the study of analysis. Our first 
result involves algebraic operations on convergent sequences. 


THEOREM 3.2.1 If {an} and {by} are convergent sequences of real num- 


bers with 
lim a, =a and lim by, = 6b, 
n—0o n—>0o 
then 
(a) Jim (an +bn) =a+b, and 
(b) lim an by = ab. 


noo 


Dn 
(c) Furthermore, ifa#0, anda, £0 for alln, then lim — = 


N00 An 


b 
a 
Proof. The proof of (a) is left to the exercises (Exercise 1). To prove (b), we 
add and subtract the term a, b to obtain 

lanby — abl = |(@nby — nb) + (dnb — ab)| < |an| |bn — b| + |b] lan — al. 


Since {a,, } converges, by Theorem 3.1.4(b), {a,,} is bounded. Thus there exists 
a constant M > 0 such that |a,| < M for all n. Therefore 


|anby, — ab] < M |b, — b| + |b Jan — al. 
Let € > 0 be given. Since a, — a, there exists a positive integer n, such that 


€ 
lan — al < S75 Fa) 
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for all n > n,. Also, since b, — 6, there exists a positive integer ng such that 
€ 

by — b| < —— 

[bn — 8] < 5a 


for all n > ng. Thus if n > max{n4, no}, 
lanby — ab] < M (=~) + [0 (say) <e. 
2M 2(|b| + 1) 
Therefore jim, Anbpn = ab. 
To prove (c) it suffices to show that Jim, 1/a, = 1/a. The result (c) then 


follows from (b). Since a 4 0 and a, > a, there exists a positive integer no 
such that 
Jan — al < 5 |al 


for all n > ng. Also, since 
|a| < Ja — an| + Jan| < 3 |a| + lan| 


for n > no, we have 


lan| > 5 lal 
for all n > no. Therefore, 
1 1 a-—a 2 
= | n < Tq lan — al. 
an a] |anllal — fal 


Let € > 0 be given. Since a, — a, we can choose an integer n; > no so that 


for all n > n,. Therefore 
1 a 


Gn a 


for all n > n1, and as a consequence 


COROLLARY 3.2.2 If {ay} is a convergent sequence of real numbers with 
lim an =a, then for anyc ER, 
noo 

(a) lim (@n +c) =a+c, and 


(b) lim can =ca. 
n> co 


Proof. If we define the sequence {cy} by cn = c for all n € N, then the 
conclusions follow by (a) and (b) of the previous theorem. 
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THEOREM 3.2.3 Let {an} and {bn} be sequences of real numbers. If {bn } 


is bounded and lim ay, = 0, then 
noo 


lim dy by, = 0. 
noo 


Proof. Exercise 3. 


Remark. Since the sequence {b,,} may not converge, Theorem 3.2.1(c) does 
not apply. The fact that the sequence {b,,} is bounded is crucial. For example, 
consider the sequences {+} and {3n}. 


THEOREM 3.2.4 Suppose {an}, {bn}, and {cn} are sequences of real num- 
bers for which there exists no © N such that 


Gn <bn< cn foralln EN n> no, 


and that lim a, = lim c, = L. Then the sequence {b,} converges and 
noo noo 


lim b, = L. 
noo 


Proof. Exercise 4 


The above result, commonly called the squeeze theorem , is very useful 
in applications. Quite often to show that a given sequence {a,,} in R converges 
to a, we will first prove that 


lan — al < Mb, 
for some positive constant M and a nonnegative sequence {b,,} with Jim bn = 
0. Since the above inequality is equivalent to 
—Mby <an—a< Mb, 
by Theorem 3.2.4 the sequence {a,, — a} converges to 0, or equivalently that 


lim dp = a. 
noo 


Some Special Sequences 


We next consider some special sequences of real numbers that occur frequently 
in the study of analysis. For the proof of Theorem 3.2.6 we require the following 
result. 


THEOREM 3.2.5 (Binomial Theorem) Foraé¢ R, n EN, 


aror=¥> (1) as (") +(‘)e+() ero(") a” 


where 


is the binomial coefficient. 
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In the above, for n € N, n! (read n factorial) is defined by 
nl=n-(n—1)---2-1, 


with the usual convention that 0! = 1. Since the binomial theorem is ancillary 
to our main topic of discussion, we leave the proof, using mathematical in- 
duction, to the exercises (Exercise 13). An alternate proof using Taylor series 
will be provided in Section 8.7. 


THEOREM 3.2.6 . 
. 1 
(a) Ifp>0, then Jim a 0. 
(b) Ifp>0, then Jim x/p = 1. 
(c) Jim, Yn =1. 


a 


(d) Ifp>1 anda is real, then lim dit 
noo p” 


(e) If |p| <1, then lim p” =0. 
n—->co 


a ae 
(f) For allpeER, jim, Al 0. 
Proof. The proofs of (a) and (b) are left to the exercises (Exercise 5). The 
proof of (a) is straightforward and the proof of (b) (for p > 1) is similar to 
the proof of (c). For the proof of (c), let , = Y/n—1. Since xp, is positive, 
by the binomial theorem 


—1 
n=(14+a,)"> (;) ps mn D2 


for all n > 2. Therefore, x2 < 2/(n — 1) for all n > 2, and as a consequence 


2 


0< < i 
=n > n—-1 


Thus by (a) and Theorem 3.2.4, lim x, = 0, from which the result follows. 
n—- co 


(d) Let k be a positive integer so that k > a. Since p > 1, write p = (1+4q), 
with g > 0. By the binomial theorem, for n > 2k, 


p’ =(1+q@)"> (;) qe = min eB 


Since k < $n, n-k+1> $n +1> sn. Therefore, 


n(n —1)---(n—k+1) n® 
i > ORR 
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and as a consequence, 


no orp! 1 
0 s = qk nk-o . 


The result now follows by part (a) and Theorem 3.2.4. 


+1 
(e) Write p as p = —, where gq > 1. Then 
qd 


1 
|p” | = |p|" = r 


which by part (d) (with a = 0) converges to 0 as n > ov. 
(f) Fix k € N such that k > |p|. For n > k, 


n (k-1 n 
lO ok Pl) 
nl ~ (kK-DI\k 


Since |p|/k < 1, the result follows by (e). 


nm 


Pp 
n! 


EXAMPLES 3.2.7 We now provide several examples to illustrate the pre- 
vious theorems. 
2n+1 


38n+2 


(a) As in Example 3.1.2(c), consider the sequence { \ We write 


Qn+1  n(2+l) 2+ 


n 


8n+2° n(3+2) 3+ 


3 [y]3 lA 


1 2 
Since lim — = lim — = 0, by Corollary 3.2.2(a), 
noo 


n no nN 


2 
lim (2 + =) =2 and lim (3 + ) ='3) 
noo n N—- Co n 


Therefore by Theorem 3.2.1(b) and (c), 


« f2HA\ SECTS 12 
lim > )=— av = 2°35 =5° 
noo \ 34 = lim (3 + 2) 3.3 
noo 
(b) Consider the sequence see . We first note that 
2/n+7 
(-1)" | _11 
0< < . 
= set 7|~ 2 Jn 
Thus by Theorems 3.2.4 and 3.2.6(a) with p = 4, 
(a1) 


lim ——*— = 
n00 Daf -+ 7 
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Vike 
(c) For our next example we consider the sequence 
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3 


r 
ee 


As in (a), 


we first factor out the dominant power in both the numerator and denomi- 
nator. By Theorem 3.2.6(d), lim n*/p” = 0 for any a € R and p > 1. This 
noo 


simply states that p” (p > 1) grows faster than any power of n. Therefore 
the dominant terms in both the numerator and denominator are 2” and 3”, 


respectively. Thus 


artn3  2"(14+ 2) 2 ae (14 


an tn? 3n(1 + Bh) (1+ gn) 


By Theorems 3.2.1 and 3.2.6(d) 


lim 
noo (1 as, a) 


Finally, since lim (3)" = 0 (Theorem 3.2.6(e)), we have 
n—->co 
: gn 4 n3 
ee i a 


(e) As out final example we consider the sequence {n((1 + +)~? — 1)}. 
Before we can evaluate the limit of this sequence we must first simplify the 


nth term of the sequence. This is accomplished as follows: 


monty? =n(Gg-1)=n(G Fae 1) 


*(GriR) - era 


Now we can factor out an n? from both the numerator and the denominator. 


This gives 
2-1 
Ln = ——“. 
a) 
Using the limit theorem we now conclude that lim x, = —2. 


n—->co 


Exercises 3.2 


1. Prove Theorem 3.2.1(a). 


2. Let {an} and {b,} be sequences of real numbers. 


a. If {an} and {an + bn} both converge, prove that the sequence {bn} 


converges. 


b. Suppose bn, # 0 for all n EN. If {bn} and {an/bn} both converge, 


prove that the sequence {an} also converges. 
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10. 


11. 
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Prove Theorem 3.2.3. 
Prove Theorem 3.2.4. 


Prove each of the following. 
a. If p > 0, prove that lim ae = 0. 
n—co nP 


*b. If p > 0, prove that lim %/p=1. 
t,t a ®, 2) 


Find the limit of each of the following sequences. 


3n? +2n+1)° n?)° 
Fa, ¢ ? b. 414+ — : 
if (eee { a 
ae Loaves = A ayn |" 
144 tf n+1Ji_4 
*e z 1 f.{Vn?+n—n}P1 
144 


*g. {vn(vnta-Vn)}~,,a>0. 0h {ar +ary/n} 


For each of the following sequences, determine whether the given se- 
quence converges or diverges. If the sequence converges, find its limit; if 
it diverges, explain why. 
T= 1)) 1 ao 
va. {14th b. {sin S| 
n pear n 25, 
2 2) n fore) 
Pre weg (anes ee 
n? \2n+3 a 2” nA oat 
te { es f {sent 
“| Yon? =4 J o4 . 


1 
*Prove that lim —cosn= =0. 
noo 1 2 


n=1 


Let {xn} be a sequence in R with z, > 0, and x, ¥ 0 for all n. Prove 


that lim zy sin — = 0. 
n—-oo Ln 


Let {an} be a sequence of positive real number such that 


lim “+! = yp, 
n>co An 
*a. If L <1, prove that the sequence {an} converges to zero. 
b. If L > 1, prove that the sequence {an} is unbounded. 


c. Give an example of a convergent sequence {an} of positive real num- 
bers for which L = 1. 


d. Give an example of a divergent sequence {an} of positive real num- 
bers for which L = 1. 


Use the previous exercise to determine convergence or divergence of each 
of the following sequences. 


2 
*a. {n?a"}, O<a< 1. b {oh o<act. 


qn 
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n ! 
of Sh o<ac. a {=t. 
ni n® 


12. *Suppose lim (an — 1)/(an +1) =0. Prove that lim an =1. 
n—-oo 


n— co 


13. a. Forn€N,1<k <n, prove that 


(+(e) Cr) 


*b. Use mathematical induction to prove the binomial theorem (Theorem 


3.2.5). 
14. Let {a,}72, be a sequence in R. For each n € N, define 
ge Mutt an 


n 


*a. Prove that if lim a, =a, then lim sp, =a. 
k- oo noo 


b. Give an example of a sequence {a,} which diverges, but for which 
{sn} converges. 


3.3. Monotone Sequences 


In this section, we will briefly consider monotone sequences of real numbers. 
As we will see, one of the advantages of such sequences is that they will either 
converge in R, or diverge to +00 or —oo. 


DEFINITION 3.3.1 A sequence {an }°2, of real numbers is said to be 
(a) monotone increasing (or nondecreasing) if a, < Gn4i for all 
n EN; 
(b) monotone decreasing (or nonincreasing) if an > Gn4i for all 
n EN; 


(c) monotone if it is either monotone increasing or monotone decreasing. 


A sequence {a,,} is strictly increasing if a, < dn41 for all n. Strictly 
decreasing is defined similarly. 


As a general rule, bounded sequences need not converge; e.g. {1 — (—1)”}. 
For monotone sequences however, we have the following convergence result. 


THEOREM 3.3.2 If {a,}°2 1 is monotone and bounded, then {an}°2, con- 
verges. 


Proof. Suppose {a,,} is monotone increasing. Set 


E={a,:n=1,2,....}. 
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Then E # § and bounded above. Let a = sup E. We now show that 


lim ay, = a. 
noo 


Let € > 0 be given. Since a — € is not an upper bound of F, there exists a 
positive integer n. such that 


a-€<Gn, <a. 
Since {a,,} is monotone increasing, 


a-€<dn<a for all n> no. 


Thus a, € N.(a) for all n > n, and therefore lim a, = a. 
noo 


- 
+H 14—44+ 


ay a ay An4] Dns b,, by by 


FIGURE 3.1 
Nested intervals property 


Nested Intervals Property 


As an application of the previous theorem we prove the following result usually 
referred to as the nested intervals property. The term nested comes from 
the fact that the sequence {J,,} of intervals satisfies I, D In41 for all n ¢ N 
(see Figure 3.1). 


COROLLARY 3.3.3 (Nested Intervals Property) If {I,}°2, is a se- 
quence of closed and bounded intervals with In D In4i for alln € N, then 


Proof. Suppose I, = [@n, bn], Gn, bn € R, an < bn. Since I, D In+m for all 
m > 0, 
an < An+tm < Dn4+m < bm 


for alln,m € N. Thus the sequence {a,,} is monotone increasing and bounded 
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above by every b,,, m € N. Thus by the previous theorem, a = jim, Gn exists 
with a < b,, for all m € N. Therefore a € I, for all m € N and ee 


co 
ac () Dyes 
m=1 


which proves the result. 


Remark. Similarly we can show that if b= lim 6,, then b € I, for all n, 
noo 


and thus o 
[a, 6] C () In. 
n=1 
In fact, one can show that equality holds. (See Exercise 3 of Section 2.4.) 


EXAMPLES 3.3.4 (a) Our first example shows that the conclusion of 
Corollary 3.3.3 is false if the intervals [,, are not closed. As in Example 
1.7.11(b), for each n € N set I, = (0,4). Then I, D In41 for all n, but 


iat 


n=1 
The conclusion of Corollary 3.3.3 may also be false if the intervals [,, are 
unbounded (Exercise 1). 


(b) Consider the sequence {p”} with 0 < p < 1. Even though Theorem 
3.2.6(e) applies, we use the results of this section to prove that lim p” = 0. 
noo 


For n € N set s, = p”. Since p > 0, Ss, > 0 for all n € N. Thus {s,,} is 
bounded below. Also, since 0 < p < 1, 


1 
Sn41 = p"*! = psy, < Sn. 


Thus the sequence {s,,} is monotone decreasing, bounded below, and hence 
by Theorem 3.3.2, is convergent. Let s = lim s,. Then 
nm—->co 


$= lim sp4, =p lim s, = ps. 
NM oo noo 


Therefore s = ps. Since p £ 1, we must have that s = 0. 

(c) Let a; = land for n > 1 set an4, = g (2am +5). The first three terms of 
the sequence {ap} are a, = 1,a2 = i, and a3 = . Thus we suspect that the 
sequence {a,,} is monotone increasing and eouived above by 2. Since a; < 2, 
if we assume that a, < 2, then 


(4+9) <2 


|e 


1 
Qn41 = g (2am + 5) < 
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Thus by mathematical induction a, < 2 for all n € N. Likewise, since a, < ag, 
if our induction hypothesis is an < @n+1, then the result is true for n = 1, and 


1 1 
An+1 = g (2am + 5) < g (2am + 5) = Gn4+2- 


Therefore the sequence {a,,} is monotone increasing, bounded above, and thus 
converges. Let a= lim a,. Then 


n—->oco 
= li = li ! 2 5) = : 2 5 
a= lim d@n41 = lim &( An + p= 51 a+ 5). 
Solving the equation a = §(2a +5) for a gives a = §. 


(d) Let a, = 1, and for n > 1, set dn41 = V2an. To investigate the 
convergence of the sequence {a,,}, we will establish by induction that 


1< an < Qn41 < 2, 
for alln € N. When n = 1, we have 
1m 2 9/2S ay <9. 
Thus the statement is true for n = 1. Assume that it is true for n = k. Then 
1 < Gg4i1 = V2aK < 4 20 = Ak+2; 


and 
Ak42 = Vf 20K41 < V4 = 2. 


Thus the sequence {a,,} is monotone increasing, bounded above by 2, and 
hence by Theorem 3.3.2 is convergent. It is possible to prove directly that 


sup{a, :n =1,2,...} = 2. 
However, if we let a= lim a,, then 
noo 
a= lim any, = lim V2ay, = V2a. 
noo noo 


The last equality follows by Exercise 6 of Section 3.1. Therefore a is a solution 
of a? = 2a, which since a > 1, implies a = 2. 
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EXAMPLE 3.3.5 In this example, we consider in detail the very important 
sequence {t, }°2.,, where for each n € N, 


1 n 
t= (142). 
nm 


We will show that the sequence {t,,} is monotone increasing and bounded 
above, and thus has a limit. The standard notation for this limit is e (in 
honor of Leonhard Euler); i-e., 


1 nm 
e= lim (1 + *) ; 
noo nr 
By the binomial theorem 


by? 1 -1)1 —1):--1 1 
t= (145) mtn 24 MD pe KO 


1-2 nn? 1-2---n nr 
For k = 1,...,n, the (&k + 1)-st term on the right side is 
n(n—1)---(n—k+1) 1 


TvOerue nk 


which is equal to 


mee 


If we expand ¢,,,1 in the same way, we obtain n+2 terms, and for k = 1,2,...,n 
the (k + 1)-st term is 


1 1 1 1 2 a ,_*2! . 
1-2---k n+1 n+1 n+1 


which is greater than the corresponding term in (2). Thus t,, < tn+41 for all n. 
From (1) we also obtain 


th <1 te ze ae ne : 
aes iy ee ane ee 1-2---n 
cag eee tea + : 
=< 9 92 gn-1 2 


which by the identity L+r+---+r"l=(r—r")/(l-r),r Al 


1-(1)" 
@) Se he tars 
ae 


=1+ I 
1-3 


Thus {t,,} is bounded above by 3, and we can apply Theorem 3.3.2. Since tpn, < 
3 for all n € N we also have that e < 3. To five decimal places, e = 2.71828... 
The number e is the base of the natural logarithm function which will be 
defined in Example 6.3.5 as a definite integral. 
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Infinite Limits 


If a monotone increasing sequence {a,,} is bounded above then by Theorem 
3.3.2 the sequence converges. If the sequence {a,,} is not bounded above, then 
for each positive real number M there exists n, € N such that a, > M for all 
nm > No. Since the real number M can be taken to be arbitrarily large, this is 
usually expressed by saying that the sequence {a,,} diverges to oo. We make 
this concept precise, not only for monotone sequences, but for any sequence 
of real numbers with the following definition. 


DEFINITION 3.3.6 Let {a,} be a sequence of real numbers. We say that 
{a,} approaches infinity, or that {a,} diverges to co, denoted an — oo, 
if for every positive real number M, there exists an integer no € N such that 


Gn > M for all n> no. 


We will also use the notation lim a, = o to denote that a, — o as 
noo 


n — oo. The concept of a, — —co is defined similarly. 


THEOREM 3.3.7 If {a,} is monotone increasing and not bounded above, 
then adn > CO as n> CO. 


As a consequence of Theorems 3.3.2 and 3.3.7, every monotone increasing 
sequence {a,,} either converges to a real number (if the sequence is bounded 
above) or diverges to oo. In either case, 


lim a, = sup{a, :n € N}. 
n—-> co 


Remark. Although the definition of diverging to infinity is included in this 
section on monotone sequences, this should not give the impression that Def- 
inition 3.3.6 is applicable only to such sequences. In the following we give an 
example of a sequence that diverges to infinity but which is not monotone. 
Also, it is important to remember that when we say that a sequence converges, 
we mean that it converges to a real number. 


EXAMPLE 3.3.8 Consider the sequence {n(2 + (—1)”)}. If n is even, then 
n(2 + (—1)") = 3n; if n is odd, then n(2 + (—1)”) =n. In either case, 


n(2+(-1)") 2n, 


and thus the sequence diverges to co. The sequence however is clearly not 
monotone. 
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1. 


10. 


*Show by example that the conclusion of Corollary 3.3.3 is false if the 
intervals I, with I, D In41 are not bounded. 


Show that each of the following sequences are monotone. find a lower or 
upper bound if it exists. Find the limit if you can. 


aces een) ee 


37 247 | 2 nT 


ce. {a"},a>1 d. {sn} where s, = cos 3 + 608 +--+ + cos 


Define the sequence {an} as follows: a1 = V2, and an41 = /2 + Gn. 
a. Show that a, < 2 for all n. 
b. Show that the sequence {a} is monotone increasing. 


c. Find lim an. 
noo 


*Let a1 > 1, and for n € N, n > 1, define an41 = 2 — 1/dn. Show that 


the sequence {a,,} is monotone and bounded. Find lim an. 
noo 


Let 0 <a <1. Set ti = 2, and for n EN, set tn41 = 2—a/tn. Show that 


the sequence {t,,} is monotone and bounded. Find lim t,. 
n—-oo 


Let a > 0. Choose x1 > \/a. For n = 1,2,3,..., define 


1 a 
In+1 = 3 («. + =). 


*a. Show that the sequence {x} is monotone and bounded. 


b. Prove that lim 2, = /a 


n> 
c. Prove that 0 < am — Va < (x2 — a)/an. 


In Exercise 6, let a = 3 and x, = 2. Use part (c) to find x, such that 
lan — V3| < 107°. 
For each of the following prove that the sequence {an} converges and find 
the limit. 

a. Qn41 = @(2an +5), a1 =2 b. dn4i = V2an, a1 = 3 
Fe. anti = V2an +3, a1 = 1 d. Gn4i = V2an +3, a1 = 4 
Fe. angi = V3an — 2,01 =4 f. Qn41 = V3an — 2, a1 = 3 
Let A be a nonempty subset of R that is bounded above and let a = 
sup A. Show that there exists a monotone increasing sequence {a,} in 
A such that a = liman. Can the sequence {an} be chosen to be strictly 
increasing? 


Use Example 3.3.5 to find the limit of each of the following sequences. 


- {(: : ) i b. (4 2)" 
foray") {0-4} 
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1 1 
11. *For each n EN, let s, = 1 5 +----+ —, Show that {s,} is monotone 
n 
increasing but not bounded above. 
1 1 
12. For each n € N, let s, = 1+ beee pt . Show that the sequence 


2 va 


{s,} is monotone increasing but not bounded above. 


1 1 1 
13. *For each n EN, let spn = p + o +-++++—>5. Show that the sequence 
n 
{s,} is monotone increasing and bounded above by 2. 
14. Let 0 < b < 1. For each n EN, let s, = 1+064 b? +--- +b". Prove 
that the sequence {s,} is monotone increasing and bounded above. Find 
lim Sn. 
noo 


15. Show that each of the following sequences diverge to +00 
n 2 
“a {Zl a>. b.{" +t}, 
ne n 
*. {n+ "} d. {n+ (-1)"Vn} 


16. *Which of the sequences in the previous exercise are not monotone? 
Explain your answer! 


17. Ifan > co and {bn} converges in R, prove that {an + bn} diverges to co. 


1 
18. Ifan > 0 for alln € N and lim ay, = 0, prove that a > oOo. 
nm—>oo 


n 


19. Suppose ai > a2 > 0. For n > 2 set an4i = 4 (an + an—1). Prove that 


a. {d2x41} is monotone decreasing. b. {a2x} is monotone increasing, 
and c. {an} converges. 


20. Let {s,} be a bounded sequence of real numbers. For each n € N let an 
and bn be defined as follows; an = inf{s, :k > n}, bn = sup{se: k > n}. 
a. Prove that the sequences {an} and {b,} are monotone and bounded. 


b. Prove that lim an = lim by if and only if the sequence {s,} con- 


21. *In Theorem 3.3.2 we used the supremum property of R to prove that 
every bounded monotone sequence converges. Prove that the converse is 
also true; namely, if every bounded monotone sequence in R converges, 
then every nonempty subset of R that is bounded above has a supremum 
in R. 


22. *Use the nested intervals property to prove that [0,1] is uncountable. 


3.4  Subsequences and the Bolzano-Weierstrass Theorem 


In this section, we will consider subsequences and subsequential limits of a 
given sequence of real numbers. One of the key results of the section is that 
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every bounded sequence of real numbers has a convergent subsequence. This 
result, also known as the sequential version of the Bolzano- Weierstrass theo- 
rem, is one of the fundamental results of real analysis. 


DEFINITION 3.4.1 Let (X,d) be a metric space. Given a sequence {py} 
in X, consider a sequence {nx}P, of positive integers such that ny < ng < 
ng <.... Then the sequence {pn,, ae is called a subsequence of the sequence 


oan 


If the sequence {p,, } converges, its limit is called a subsequential limit of 
the sequence {p,,}. Specifically, a point p € X is a subsequential limit of 
the sequence {p,} if there exists a subsequence {p,,, } of {p,} that converges 
to p. Also, given a sequence {p,} in R, we say that co is a subsequential 
limit of {p,,} if there exists a subsequence {p,,,} so that pn, — co as k + ov. 
Similarly for —oo. 


EXAMPLES 3.4.2 (a) Consider the sequence {1 — (—1)”}. If n is even, 
then a, = 0, and if n is odd, then a, = 2. Thus 0 and 2 are subsequential 
limits of the given sequence. That these are the only two subsequential limits 
are left to the exercises (Exercise 1). 


(b) As our second example, consider the sequence {(—1)"++}. Then both 
1 and —1 are subsequential limits. If n is even, i.e., n = 2k, then 


1 
On = Gar =1+ 57, 


which converges to 1. On the other hand, if n is odd, i.e., n = 2k + 1, then 


1 


n= =-1+——., 
a A2k+1 + ead 


which converges to —1. This shows that —1 and 1 are subsequential limits. 
Suppose {a,,,} is any subsequence of {a,,}. If the sequence {n;,} contains an 
infinite number of both odd and even integers, then the subsequence {a,, } 
cannot converge. (Why?) On the other hand, if all but a finite number of the 
Np are even, then {a,,} converges to 1. Similarly, if all but a finite number 
of the n;, are odd, then {a,, } converges to —1. Thus —1 and 1 are the only 
subsequential limits of {a, }. 

(c) Consider the sequence {n(1+(—1)”)}. If n is even, then n(1+(—1)”) = 
2n, whereas if n is odd, n(1+(—1)”) = 0. Thus 0 and oo are two subsequential 
limits of the sequence. The same argument as in (b) proves that these are the 
only two subsequential limits. 


Our first result assures us that for convergent sequences, every subsequence 
also converges to the same limit. 
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THEOREM 3.4.3 Let (X,d) be a metric space and let {py} be a sequence 
in X. If {pn} converges to p, then every subsequence of {pn} also converges 
to p. 


Proof. Let {pn,} be a subsequence of {p,}, and let € > 0 be given. Since 
Dn — p, there exists a positive integer n, such that d(pn,p) < € for alln > no. 
Since {nx} is strictly increasing, nz > no for all k > n,. Therefore, 


d(PnyzsP) < E 


for all k > no, i-e., Pn, > p- 


EXAMPLES 3.4.4 (a) In this example, we give an application of Theorem 
3.4.3. Consider the sequence {p"} where 0 < p < 1. Since 


Oe pthc pei 
for all n, the sequence {p”} is monotone decreasing, bounded below, and hence 
converges. Let 
a= lim p”. 
noo 

By Theorem 3.4.3 the subsequence {p?”} also converges to a. But p?” = (p”)?, 
and thus 

a= lim p?” = lim (p")? = ?. 

noo noo 


Thus a? = a. Since 0 < a < 1, we must have a = 0. 

(b) In our second example we show how the previous theorem may be used 
to prove divergence of a sequence. Consider the sequence {sinn67}, where 0 
is a rational number with 0 < 6 < 1. Write 0 = a/b, with a,b € N and 
b > 2. When a = kb,k € N, then sinnéa = sinkax = 0. Therefore 0 is a 
subsequential limit of the sequence. On the other hand, if n = 2kb+1,k EN, 
then 


sinnOa = sin (2kb + 1)—7 = sin (2har + <r) 


b 


ols 


= cos(2kar) sin ad = sin a 


Since 0 < a/b < 1, sin ¢a 4 0. Thus sin ¢7 is another distinct subsequential 
limit of {sinn6a}. Hence as a consequence of Theorem 3.4.3 the sequence 
{sin nOz} diverges. The result is still true if @ is irrational. The proof however 
is much more difficult. 


The following result, which is a sequential version of Theorem 2.3.7, will 
prove useful in subsequent results. 


THEOREM 3.4.5 Let K be a compact subset of a metric space (X,d). Then 
every sequence in K has a convergent subsequence which converges in K. 
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Proof. Let {p,} be a sequence in K, and let E = {p, :n=1,2,...}. If E is 
finite, then there exists a point p € EF and a sequence {nz} with ni < ng <... 
such that 

Pni = Png =°°* =P. 
The subsequence {pp } obviously converges to p which is in K. 

If E is infinite, then by Theorem 2.3.7, F has a limit point p € kK. Choose 
mn, such that d(p,pn,) < 1. Having chosen nj,...,N%~-1, choose an integer 
Nk > Ne—1 So that 

UP, Pry) < = 
Such an integer n, exists since every neighborhood of p contains infinitely 
many points of E. The sequence {p,,} is a subsequence of {p,}, which by 
construction converges to p€ Kk. 


We are now ready to state and prove the sequential version Bolzano- 
Weierstrass theorem. 


COROLLARY 3.4.6 (Bolzano-Weierstrass) Every bounded sequence in 


R has a convergent subsequence. 


Proof. Suppose {p,,} is a bounded sequence in R. Then there exists a positive 
integer M such that {p,,} is a sequence in the compact set [—M, M]. The result 
now follows by the previous theorem. 


Remark. The converse of Theorem 3.4.5 is also true. If K is a subset of 
a metric space (X,d) having the property that every sequence in Kk has a 
convergent subsequence, then K is compact. For metric spaces, the proof of 
the converse is similar to Miscellaneous Exercise 4 of the previous chapter. 

If K is a subset of R, then the hypothesis can be used to show that K is 
closed and bounded, and thus by Theorem 2.4.2 is compact. 

An argument similar to the one used in the previous Corollary may be 
used to prove the following. 


THEOREM 3.4.7 Let {pn} be a sequence in a metric space(X,d). If p is 
a limit point of {pn : p € N}, then there exists a subsequence {pn,} of {pn} 
such that pn, + p as k + oo. 


Proof. Exercise 8 


As an application of Theorem 3.4.7 we consider the following example. 


EXAMPLE 3.4.8 Let {r,}°2, be an enumeration of the rational numbers 
in [0,1]. By Example 2.2.13(c), every p € [0,1] is a limit point of {r, :n = 
1,2,...}. Thus if p € [0,1], there exists a subsequence {rn,} of {r,} such 
that r,, — p. The sequence {r,,} has the property that every p € [0,1] is a 
subsequential limit of the sequence. This sequence also provides an example 
of a sequence for which the set of subsequential limits of the sequence is 
uncountable. 
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Exercises 3.4 


1. a. Prove that 0 and 2 are the only subsequential limits of the sequence 
{ha(at)"} 

b. Prove that 0 and oo are the only subsequential limits of the sequence 
{n(1 + (-1)")}. 

2. a. Construct a sequence {s,} for which the subsequential limits are 
{—oo, —2, 1}. 

b. Construct a sequence {s,} for which the set of subsequential limits is 
countable. 

3. Find all the subsequential limits of the following sequences. 

_ nT . nT 

*a, {sin}. b. {nsin 
2 4 

*e, {(-1)" + 2sin } f. {nsin =} 

4. Use Example 3.3.5 to find the limit of each of the following sequences. 

Justify your answer. 
6n n n 
*a, 1+ = b. 1+ Es c. 1+ Z 
3n 2n n 
5. Suppose p > 1. Use the method of Example 3.4.4 to show that lim ~/p = 
n—-+oco 
li 
6. Forn€Nset pp =n”. 
a. Show that 1 < pn+4i < pn for alln > 3. 
b. Let p = jim, Pn. Use the fact that the subsequence {p2n} also con- 
verges to p to Reonginge that p = 1. 

7. Let {p,} be a bounded sequence of real numbers and let p € R be such 
that every convergent subsequence of {pn} converges to p. Prove that the 
sequence {p,} converges to p. 

Prove Theorem 3.4.7. 
Prove that every sequence in R has a monotone subsequence. 
10. *Prove that every bounded sequence in R” has a convergent subsequence. 
11. Use the Bolzano-Weierstrass theorem to prove the nested intervals prop- 
erty (Corollary 3.3.3). 
12. Prove that every uncountable subset of R has a limit point in R. 
Se 


3.5 Limit Superior and Inferior of a Sequence 


In this section, we define the limit superior and limit inferior of a sequence 
of real numbers. These two limit operations are important because unlike the 
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limit of a sequence, the limit superior and limit inferior of a sequence always 
exist. The concept of the limit superior and limit inferior will also be important 
in our study of both series of real numbers and power series. 


Let {s,} be a sequence in R. For each k € N, we define ax and by as 
follows: 


ay = inf{s, :n>k}, 
by = sup{sp, :n>k}. 
Recall that for a nonempty subset EF of R, sup E is the least upper bound of 
F if E is bounded above, and co otherwise. 
From the definition, a, < 6b, for all k. Furthermore, the sequences {a; } 
and {b,} satisfy the following: 
Gk < Oh41 and bp > bey (3) 


for all k. To prove (3), let Ey = {s,:n > k}. Then Ex4i C Ex. Therefore, if 
by, = sup Ex, 8, < by for all n > k. In particular 


Sn < by for all n >k+1. 


Therefore bg, = sup Ex41 < by. A similar argument will show that the 
sequence {a,} is nondecreasing. 


As a consequence of (3) the sequence {a,} is monotone increasing and 
the sequence {b;,} is monotone decreasing. Thus by Theorems 3.3.2 and 3.3.7, 
these two sequences always have limits in RU {—00, oo}. 


DEFINITION 3.5.1 Let {sn} be a sequence in R. The limit superior of 
{s,}, denoted lim sy or lims,, is defined as 
noo 


lim = li = infs :n>kth. 
sO ree yen 
The limit inferior of {s,,}, denoted lim s,, or lims,, is defined as 
noo 


lim s, = lim ay = supinf{s, :n> k}. 
noo k-0o keEN 


We now give several examples for which we will compute the limit inferior 
and limit superior. As will be evident, these computations are very tedious. 
An easier method will be given in Theorem 3.5.7. 


EXAMPLES 3.5.2 (a) {1+ (—1)"}02,. Let s, =1+(-1)”. Then s, = 2 
if n is even, 0 otherwise. Thus a, = 0 for all k and by = 2 for all k. Therefore 


lim s, =2 and lim s, = 0. 
n—-0o noo 


108 Introduction to Real Analysis 
(b) {n (1 + (—1)”)}92,. In this example, 


if n is od 
8, =n(1+(-1)") = 0, ee d, 
2n, if n is even. 
Set Ey = {8,:n > k}. Then 


Ex = {0, 2(k +1), 0, 2(k +3), «--} if k is odd, 
Ex, = {2k, 0, 2(k + 2), 0, 2(k + 4), ---} if k is even. 


Therefore ay, = inf E, = 0, and by = sup Ex, = oo. Thus 


lim s,=0O and lim s, =o. 
noo noo 


(c) {(—1)" + 2}92.,. Set sn = (—1)" + 1/n. Then 


ti 
Sn = 
T+ 


To compute the limit superior and inferior of the sequence {s,,}, we set E, = 
{s,:n > k}. If k is even, then 


a il 1 I 1 
Ey= {1 U 1+ gal ' pa}. 


Therefore, for k even, 


: n odd, 


; nm even. 


SiR sIFR 


1 
by = sup Ey = 1+ 7 and ay, = inf Ey = —1. 


Similarly, for k odd, 


1 
Oe = SUD Be Dg and ay, = inf Ey, = -1. 


As a consequence, 


1 
1+ R k even, 
ay =—1 forall k, bp = l 
1+ —.,_ k odd. 
k+1 
Thus 
lim s,=1 and lim s, =—1. 
nm—-00 noo 


The following theorem provides an (€,n,) characterization of the limit su- 
perior. An analogous characterization for the limit inferior is given in Theorem 
3.5.4. 
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THEOREM 3.5.3 Let {s,}°2, be a sequence in R. 
(a) Suppose tim Sn €R. Then B= Jim Sn Uf and only if for alle > 0 
(i) there exists no € N such that 8, < 8+.e for alln > no, and 
(ii) givenn EN, there existsk € N with k > n such that 5, > B—€. 
(b) Jim, Sn = co Uf and only if given M and n €N, there exists k Ee N 
with k > n such that s, > M. 


(c) lim s, = —oo if and only if 8, > —0oo as n > oo. 
noo 


Remark. The statement “s, < 6+ for all n >n,” means that s, < 6 +e 
for all but finitely many n. On the other hand, the statement “given n, there 
exists k € N with k > n such that s, > G — ©” means that s, > @ —€« for 
infinitely many indices n. 


THEOREM 3.5.4 Let {s,} be a sequence in R. 
(a’) Suppose ha. 8, €R. Thena= lim s, if and only if for alle > 0 


noo 
(i) eo ae no EN such that s, > a—e for alln > n,, and 
(ii) givenn EN, there exists k © N with k > n such that s, <a+e. 
(b’) lim s, = —oo if and only if given M andn EN, there exists k € N 
with k en that sp < M. 
(c’) lim s, =o éf and only if 8, 4 oo as n> co. 


n—->oco 


Proof of Theorem 3.5.3 We will only proof (a). The proofs of (b) and (c) 
are left to the exercises (Exercise 5). 


(a) Suppose 6 = lim s, = jim by where 
00 
by = sup{s, : n> k}. 


Let € > 0 be given. Since jim by, = @ there exists a positive integer n, such 
k—-00 
that by < 6+ € for all k > n,. Since s, < by for all n > k, 


Sn <B+eE for all n > no. 


This proves (i). Suppose n € N is given. Since b, > (3, and {b,} is monotone 
decreasing, b, > 6 for all k. In particular, b,, > 6. By the definition of b, 
however, given € > 0, there exists an integer k > n such that 


Sk > bn —€ > B-€, 


which proves (ii). 
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Conversely, assume that (i) and (ii) hold. Let ¢ > 0 be given. By (i) there 
exists no € N such that s, < 6+ € for all n > n,. Therefore 


bn, = Sup{S,:n> no} <B+e. 


Since the sequence {b,,} is monotone decreasing, b, < 8+ for all n > no. 
Thus 

lims, = limb, < 6 +e. 
Since € > 0 was arbitrary, lims, < 6. 


Suppose 3’ = lims, < 6. Choose € > 0 such that 8’ < 8 — 2e. But then 
there exists n, such that 


Sn <8 +e<B-e for all n > no, 


which contradicts (ii). Thus lim s,, = 6. 


To illustrate the previous two theorems, consider the sequence 
8, = (-1)"+1/n 


of Example 3.5.2(c). For this sequence, lims, = 1 and lims, = —1. Given 
e > 0, then 
Sn <1+e 


for all n € N with n > 1/e. Since the odd terms get close to —1, we can never 
have the existence of an integer n, such that s, > 1—e for all n > n,. On 
the other hand, given any n € N, there exists an even integer k > n such that 
8h >1l-e. 
An immediate consequence of the previous two theorems is as follows: 
COROLLARY 3.5.5 lim s, = lim s, if and only if lim sy exists in 
noo n+ oo 


n—->Co 


RU {—o0, oo}. 


Proof. Suppose lim s,, = lim s,, = a € R. Let € > 0 be given. By (a) and (a’) 
of the previous two theorems, there exist positive integers n,; and nz, such 
that 

Sn <at+eE forall n>mn,, and 


Sn >a-e€ for all n> ng. 
Thus if ng = max{n4, no}, 
A-€<S8,< ate 


for all n > n,; i.e., lim s, = a. The proofs of the cases a = oo or @ = —00 
noo 
are similar. 


If lim s, =a, then it easily follows that both lim s,, = a and lims, = a. 
noo 
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THEOREM 3.5.6 Let {an} and {b,} be bounded sequences in R. Then 


lim an + lim bp < lim (an + bn) < lim an + lim bp 
noo noo noo n—-0o n—-0co 


< lim (a, +b,) < lim ay, + lim by. 
noo noo n->co 


Proof. Exercise 6 


The following theorem relates the limit superior and inferior of a sequence 
to the subsequential limits of the sequence, and is in fact very useful for finding 
lim s, and lim s,, of a sequence {s, }. 


THEOREM 3.5.7 Let {s,}°2, be a sequence in R and let 
E = the set of subsequential limits of {sy} in RU {—co, oo}. 


Then lim s, and lim sy, are in E and 
nC n—>oo 


(a) lim s, =sup FE, and 
noo 
(b) lim s,, = inf E. 
noo 
Proof. Let s = lims,. Suppose s € R. To show that s € E, we show the 


existence of a subsequence {sy} of {8,} which converges to s. Take € = 1. 
Let n, be the smallest integer such that 


s—1l<s,, <stl. 


Such an integer exists by (i) and (ii) of Theorem 3.5.3(a). Suppose ny < ng < 
+++ < mz have been chosen. Take € = ea: Let nz41 be the smallest integer 
greater than n, such that 


a 


SF eee 


di 
< Srp <8 4 RAT: 


Again, such an integer exists by (i) and (ii) of Theorem 3.5.3(a). Then {s,, } 
is a subsequence of {s,,} which clearly converges to s. Therefore s € E. The 
case s = oo is treated similarly. If s = —oo, then by (c) of Theorem 3.5.3, 
Sn — —00 as N — OO. 


Since s € FE, s < sup E. It remains to be shown that sup FE = s. If s = co 
we are done. Otherwise, suppose sup £ = 6 > s. Suppose 3 4 oo. Then there 
exists a € FE such that 

s<a<f. 


Since a € R, we can choose € > 0 such that s +e < a—e. For this ¢, there 
exists no € N such that s, < s+e for all n > n,. Hence there can exist only 
finitely many k such that 

|s, —a| <e. 


Consequently no subsequence of {s,} can converge to a. This contradiction 
shows that sup F = s. The case 8 = oo is treated similarly. 
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EXAMPLES 3.5.8 In the following examples we use Theorem 3.5.7 to com- 
pute lim s,, and lim s,, for each of the given sequences {s,,}. 


(a) Let s, = (—1)" + 1/n. By Example 3.4.2(b), the set of subsequential 
limits of {s,,} is {—1,1}. Thus by the previous theorem, 


lim s, = —1 and lim s, = 1. 


(b) Let s, = n(1 + (—1)"). By Example 3.4.2(c) the subsequential limits 
of {s,,} are 0 and oo. Therefore, 


lim s, = 0 and lim sy = 00. 


(c) Let s, = sin ae If n is even, ie., n = 2k, then sox, = sinkam = 0. On 


the other hand, if n is odd, i.e., n = 2k+1, then so,41 = sin(2k+1)5 = (-1)*. 
Hence the set of subsequential limits of the sequence {s,,} is {—1,0,1}. Asa 
consequence, 


lim s, = —-1 and litt $a. 11; 


Exercises 3.5 


1. Find the limit inferior and limit superior of each of the following se- 


3. aie 
ie jeoe | atten ry 
e. { £ +n(1 + cosna)} vg fh 


2. Let {an} be a sequence in R. If lim|an| = 0, prove that lim an = 0. 
n—-oo 
3. *Let {rz} be an enumeration of the rationals in (0,1). Find limr, and 
limrn. 


4. Let {sn} be a sequence in R. If s € R satisfies that for every € > 0, there 
exists no € N such sy < s+e for all n > no, prove that lims, < s. 


5. a. Prove Theorem 3.5.3(b). 
b. Prove Theorem 3.5.3(c). 
6. *a. Let {an} and {b,} be bounded sequences in R. Prove that 


lim ay + limbn < lim(an + bn) < lima, + limb,. 


b. Give an example to show that equality need not hold in (a). 
7. a. If an and bp are positive for all n, prove that 
Tim(an bn) < (lim an) (lim bn), 
provided the product on the right is not of the form 0- oo. 
b. Need equality hold in (a)? 
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8. *Let s; =0. Forn €N, n> 1, let s, be defined by 


S2m-1 


52m = 9 , S2m4+1 = 3 + Sam. 
Find lim sy, and lim sp. 
9. Let an > 0 for all n. Prove that lim ?/an < lim ee 


10. *Suppose {an}, {bn} are sequences of nonnegative real numbers with 


lim b, =b40, and lim a, =a. Prove that lim anb, = ab. 
noo noo n—- co 


3.6 Cauchy Sequences 


In order to apply the definition to prove that a given sequence {p,,} converges, 
it is required that we know the limit of the sequence {p,,}. For this reason, 
theorems that provide sufficient conditions for convergence, such as Theorem 
3.3.2, are particularly useful. The drawback to Theorem 3.3.2 is that it applies 
only to monotone sequences of real numbers. In this section, we consider 
another criterion that for sequences in R is sufficient to ensure convergence of 
the sequence. 


DEFINITION 3.6.1 Let (X,d) be a metric space. A sequence {py}, in 
X is a Cauchy sequence if for every « > 0, there exists a positive integer 
No such that 

d(Pn; Pm) <e 


for all integers n,m > No. 


Remark. In the above definition, the criterion d(py,Pm) < € for all integers 
n,M > Np is equivalent to 
A(Pn+ks Pn) <€ 


for alln > n, and all k € N. Thus if {p,} is a Cauchy sequence in X, 
lim A(Pn+tks Pn) =0 
noo 


for every & € N. The converse however is false; namely, if {p,,} is a sequence 

in R that satisfies lim d(pp+z%,pn) = 0 for every k € N, this does not imply 
noo 

that the sequence {p,,} is a Cauchy sequence (Exercise 4). The hypothesis 

only implies that for each k € N, given e > 0, there exists a positive integer 

No such that d(pn+k, Pn) < € for all n > no. 
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THEOREM 3.6.2 Let (X,d) be a metric space 
(a) Every convergent sequence in X is a Cauchy sequence. 


(b) Every Cauchy sequence is bounded. 


Proof. (a) Suppose that {p,} converges to p € X. Let € > 0 be given. Then 
for the given ¢, there exists a positive integer n. such that 


d(pn, Pp) < $e 
for all n > no. Thus by the triangle inequality, ifn, m > no, 
(Pn, Pm) < (Pn, Pp) + d(P, Pm) < FE + 56 = 


(b) Take « = 1. By the definition of Cauchy sequence, there exists n, € N 
such that d(pn,pm) <1 for all n, m > no. Let 


M= max{1, d(p1,Pn.)s Bae ,A(Pn,—1; Pn) }- 


Then for all n, d(pn,Pn,) < M. Thus {py} is bounded. 


EXAMPLES 3.6.3 (a) Let X = (0,1) with d(x,y) = |x — y|. Consider 
the sequence {1/n}°2,. Let € > 0 be given. Choose an integer n, such that 
1/n < €/2 for alln > no. Then for all n,m > no, 


1 


n 


a(t, 2) = + 


| 1 1 
< t <e€. 
m n 


Thus the sequence {1/n} is Cauchy but does not converge in X. In R the 
sequence converges to 0, but 0 ¢ X. Intuitively, a Cauchy sequence that fails 
to converge does so because of the absence of a point or element in the space 
to which it can converge. 

(b) Let X = Q with d(p,q) = |p — q|. If {pn} is any sequence of rational 
numbers that converges to an irrational number, then the sequence {p,,} is a 
Cauchy sequence in (Q,d), which however does not converge in Q. 


THEOREM 3.6.4 If {p,} is a Cauchy sequence in a metric space X that 
has a convergent subsequence, then the sequence {p,} converges. 


Proof. Suppose {p,,} is a convergent subsequence of {p,,} with limp,, = p. 
Let € > 0 be given. Since {p,,} is Cauchy, there exists an integer Ni such that 


d(Pn,Pm) < se for all n, m > Nj. 
Since pn, — p, for the given ¢, there exists an integer k, such that 


A(PnxsP) < 4€ for all k > ky. 
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Let no = max{k1, Ni}, and choose ng such that k > no. Then ny > Ni. Thus 
if n > no, by the triangle inequality 


A(Pn,P) < d(Pn, Pn, ) a (Pry P) < se oF iG = €. 


Therefore limp, = p, which proves the result. 


THEOREM 3.6.5 Every Cauchy sequence of real numbers converges. 


Proof. Let {p,,} be a Cauchy sequence in R. By Theorem 3.6.2, the sequence 
{pn} is bounded. Thus by Corollary 3.4.6, the sequence {p,,} has a convergent 
subsequence. The result now follows by Theorem 3.6.4. 


DEFINITION 3.6.6 A metric space (X,d) is said to be complete if every 
Cauchy sequence in X converges to a point in X. 


As an example, R with the usual metric is complete. In the exercises you 
will be asked to prove that R? with the euclidean metric is also complete. 
Additional examples of complete metric spaces will be encountered in subse- 
quent chapters. Since the proof of Theorem 3.6.5 used the Bolzano- Weierstrass 
theorem, the completeness of R ultimately depends on the least upper bound 
property of R. Conversely, if we assume completeness of R, then we can prove 
that R satisfies the least upper bound property (Exercise 14). For this rea- 
son the least upper bound or supremum property of R is often called the 
completeness property of R. 


EXAMPLES 3.6.7 (a) For our first example we consider the sequence {s,, } 
where for n € N 


1 i} 
For k EN, 

| l= tet 

orth Sl tle (tke 
e 1 1 Ps fy 1 1 
= n n+l n+k-1 n+k 
i. & 
nm ntk 


In the above we have used the inequality 


1 1 1 
(n+m)? ~\n+t+m—-1 n+m 


valid for all n,m € N. Since the sequence { +} converges, it is a Cauchy 
1 1 


sequence. Thus given € > 0 there exists no € N such that | — >4_| < «€ for 
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all n > n, and all & € N. Therefore the sequence {s,,} is a Cauchy sequence 
and hence converges. 


(b) In our second example we give an application to illustrate how the 
concept of a Cauchy sequence may be used to prove convergence of a given 
sequence. Additional applications will be given in the exercises. Let a, a2 be 
arbitrary real numbers with a; 4 ag. For n > 3, define a, inductively by 


an = (Qn—1 + Gn—2). 


ND] re 


Our first goal is to show that the sequence {a,,} is Cauchy. We first note that 


Qn+1 an = 5 (Gn Gn—1). 
As a consequence, for n > 2, 
One1 = Oy = (—3)"* (a2 — 21). (4) 


This last statement is most easily verified by induction (Exercise 5). Form > 1, 
consider |@n4m — @n|. By the triangle inequality, 


m-1 m-1 
lQntm > Ay| = S An+k+1 — On+k < lQn4k4+1 — An+k]s 
k=0 k=0 


which by the above 


m-1 


1 1 =e 
< |az — a4| S gn+k—1 = png |@2 a| >> Ok 
k=0 Kel 


By Example 1.3.2(a) 


lle r—rmtl 
r= s+ Fil (5) 
k=1 
Thus with r = 3 
m 1 1\m+1 
k m 
ae 2 ees 2 
Therefore, 
lance ay| < Qn 5 a2 ay| 


for alln > 2 and m EN. Let € > 0 be given. Choose n, such that 
|az — a,|/2"~? < € for all n > ny. Then by the above, 


|@n4tm = An| <e 
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for allm € N, n > no. This however is just another way of stating that 
lan — Am| < € for all m,n> no. 


Therefore the sequence {a,,} is a Cauchy sequence in R, and thus by Theorem 
3.6.5, 


a= lim ay, 
noo 


exists in R. 
Can we find the limit a here? If we take the same approach as in Example 


3.3.4(c), by taking the limit of both sides of equation (5) we only get a = a. 
To find the value of a, let us observe that 


An41 — 1 = (Gn41 — Gn) + (Gn — Gn—1) + +++ + (a2 — 4) 
n 
= Qk41 — ak), 
k=l 


then use (4) to get 


(a2 — a1 Sic —4)- 
k=1 
Veg) 


The last equality follows from formula (5). Since an41 > a and (—$)" > 0, 
upon taking the limit of both sides we obtain 


= 3 (a2 ay 


a-a= 2 (a2 — a1) or a = a, + 2(a2 — a4). 


Contractive Sequences 


One of the key properties of the sequence {a,,} of the previous example was 
that 

|Qn+1 = An| < $|an — Gn—1| 
for all n > 2. This property was used to show that the sequence {a,,} was a 
Cauchy sequence and thus converged. Sequences that satisfy a criterion such 
as the above are commonly referred to as contractive sequences. We make this 
precise in the following definition. 


DEFINITION 3.6.8 A sequence {p,} in a metric space (X,d) is contrac- 
tive if there exists a real number b,0 <b <1, such that 


A(Pn41;Pn) < bd(pn; Pn—1) 


for alin EN, n> 2. 
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If {p,} is a contractive sequence, then an argument similar to the one used 
in the previous example shows that 


d(pn41,Pn) < b"~'d(p2,p1) 


for all n > 1, and that 


n—1 


b 
d(PntmsPn) <b" d(po, Pi) + 6 +++ +b") < 


d(p2, 1) 


for all n,m € N. As a consequence, every contractive sequence is a Cauchy 
sequence. Therefore, if (X,d) is a complete metric space, every contractive 
sequence in X converges to a point in X. We summarize this in the following 
theorem. 


THEOREM 3.6.9 Let (X,d) be a complete metric space. Then every con- 
tractive sequence in X converges in X. Furthermore, if the sequence {py} is 
contractive and p= limp,, then 

n—1 


(a) d(p.pn) < 


(b) d(p,pn) < 
Definition 3.6.8. 


d(p2,P1), and 


Tog olPn Pn-1); where 0 < b < 1 is the constant in 


Proof. We leave the details of the proof to the exercises (Exercise 9). 


Exercises 3.6 
1. If {an} and {b,} are Cauchy sequences in R, prove (without using The- 
orem 3.6.5) that {an + bn} and {anbn} are also Cauchy sequences. 


2. For each of the following determine whether the given sequence is a 
Cauchy sequence. 


a. { ri . {(-1)"} cant . 
1+(-1)"n 1+(-1)"n? 1\" 
*d. § —+—_ a ee f. 1+ — ; 
{ ne+3 \ © { In? +3 7 a 
3. For n EN let s, =1+ : | 5 fe+-4 - Prove that {s,} is a Cauchy 
sequence. : : ie 
4. Consider the sequence {s,,} defined by s, = 1+ ; feet - 
n 


*a. Show that {s,} is not a Cauchy sequence. 
b. Even though {s,,} is not a Cauchy sequence, show that 


lim |sn+n — Sn| =0 for all k EN. 
noo 


5. Use mathematical induction to prove Identity (4). 
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6. If K isacompact subset of a metric space (X, d), prove that every Cauchy 
sequence in K converges to a point in K. 


7. Prove that (R?,d2) is complete. 
8. Let {an} be the sequence of Example 3.6.7(b). 


a. Use mathematical induction to prove that 
1 1 1 
A2k+1 = paRci (11 + a2) 4 3 (a + 2a2) (:- 7): 
b. Use the result of (a) to find liman. 
9. Prove Theorem 3.6.9. 


10. *Let a1 > 0, and for n > 2, define an = (2+ dn—1)'. Prove that {an} 


is contractive, and find lim an. 
n—-oco 


11. Let ec: € (0,1) be arbitrary, and for n € N set eny1 = $ (cp +2). 


a. Show that {c,} is contractive. 
b. Let c= lim c, Show that c is a solution of x? —52+2=0. 
n—- co 


c. Let cy = 3 Using the result of Theorem 3.6.9, determine the value of 


n such that Jen — c| < 107°. 


12. Consider the polynomial p(x) = 2? +5a—1. It can be shown that p(x) has 
exactly one root in the open interval (0,1). Let a1 € (0,1) be arbitrary, 


and for n > 1, set an41 = (1 — a3). 


a. Prove that the sequence {a,,} is contractive. 
b. Show that if a= Jim, Gn, then p(a) = 0. 
c. Let ai = 3 Using the result of Theorem 3.6.9(b), determine the value 
of n such that Jan — a| < 107%. 
13. Let a; 4 a2 be real numbers, and let 0 < b < 1. For n > 3, set 
Gn = ban—1 + (1 — 6) an—2. 
a. Show that the sequence {a,} is contractive. 


*b. Find lim an. 
noo 


14. Prove that if every Cauchy sequence in R converges, then every nonempty 
subset of R that is bounded above has a supremum. 


3.7 Series of Real Numbers 


In this section, we will give a brief introduction to series of real numbers. Some 
knowledge of series, especially series with nonnegative terms, will be required 
in Chapter 4. The topic of series in general, including various convergence 
tests, alternating series, etc., will be treated in much greater detail in Chapter 
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7. We begin with some preliminary notation. If {a,}92, is a sequence in R 
and if p, q € N with p < q, set 


q 
) Ak = Ap + Api ++++ + Aq. 
k=p 


DEFINITION 3.7.1 Let {a,}°, be a sequence of real numbers. Let 
{sn }°21 be the sequence obtained from {an}, where for each n EN, sp = 
So ax. The sequence {8,,} is called an infinite series, or series, and is de- 


k=1 
noted either as 


co 
) Qk or as ay +@g+-:'+An+:::. 
k=1 


For eachn EN, Sy is called the nth partial sum of the series and ay is called 
the nth term of the series. 


co 
The series )~ ay, converges if and only if the sequence {s,} of nth partial 
k=1 
sums converges in R. If lim s, = s, then s is called the sum of the series, 
noo 


Co 
s= ) Qk. 
ket, 


and we write 


co 
If the sequence {s,} diverges, then the series \~ ax is said to diverge. 
k=1 


EXAMPLES 3.7.2 (a) For |r| < 1, consider the geometric series 


For nEN, 


Thus 


(l—1r) 8, = 8 —Tan =r—r"™™, 


and as a consequence 
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Since |r| < 1, by Theorem 3.2.6(e), lim r” = 0. Therefore lim s, =r/(1-r), 
noo n+ oo 


and thus & 
ae 
Sor Sa Ir] <1. 
k=1 


For |r| > 1 the series 5> r* diverges (Exercise 3). 


n=1 
(b) Consider the series + ax, where for each k € N, ay, = (; - ra): 
k=1 kK k+l 
Then 
Sn = ye Qk 
k=1 
(1-2) -G-ee (ah) 
2 2 3 n n+l 
_ 1 
= ap 
Thus lim s, = 1 and hence 3 dp = 1. 


(c) Consider 5> (—1)*. Then 
k=1 


io: s(-0 = 0, ‘ n i even, 
ee -1 if n is odd. 


9 


Thus since {s,,} diverges, the series diverges. 


The Cauchy Criterion 


The following criterion, which provides necessary and sufficient conditions for 
the convergence of a series, was formulated by Augustin-Louis Cauchy (1789- 
1857) in 1821. 


Co 

THEOREM 3.7.3 (Cauchy Criterion) The series 5) ax, converges if and 
k=1 

only if given e > 0, there exists a positive integer no, such that 


m 


ya 


k=n+1 


SE 


for alm >n> no. 
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Proof. Since 


as 


k=n+1 


= |Sim a Sn, 


the result is an immediate consequence of Theorems 3.6.2 and 3.6.5. 


Remark. The previous theorem simply states that the series }> a, converges 
if and only if the sequence {s,,} of nth partial sums is a Cauchy sequence. 


EXAMPLE 3.7.4 In this example, we show that the series = 1/k diverges. 


We accomplish this by showing that the sequence {s,,} of a cal sums is not 
a Cauchy sequence. Consider 
1 1 


S2n aa re neN. 


There are exactly n terms in the sum on the right, and each term is greater 
than or equal to 1/2n. Therefore 


1 1 
$2n — Sn 21 5) ae 


The sequence {s,,} therefore fails to be a Cauchy sequence and thus the series 
diverges. The divergence of this series appears to have been first established by 
Nicole Oresme (1323?-1382) using a method of proof similar to that suggested 
in the solution of Exercise 11 of Section 3.3 


COROLLARY 3.7.5 If >> ax converges, then jim ap = 0. 


Proof. Since ay, = 5, — 8,1, this is an immediate consequence of the Cauchy 
criterion. 


Remark. The condition jim ay, = 0 is not sufficient for the convergence of 
00 


>> ay. For example, the series }> i diverges, yet jim i = 0. 
00 


THEOREM 3.7.6 Suppose a; > 0 for allk € N. Then S> ay converges if 
k=1 
and only if {8,} is bounded above. 


Proof. Since a, > 0 for all k, the sequence {s,,} is monotone increasing. Thus 
by Theorem 3.3.2, the sequence {s,,} converges if and only if it is bounded 
above. 
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Exercises 3.7 


1 1 1 1 
1. *Using the inequality © < Me) aay prove that the series 
1 
iS pz converges. 
k=1 
2. Prove that the series » Pak converges. 


3. If |r| > 1, show that the series 5> r* diverges. 
k=1 


4. Prove that the series 5> a converges. (See Exercise 13 of Section 3.6.) 
k= Ms 


5. *Suppose az > 0 for all k. Prove that if }> ax converges, then 


s, v converges. 
k=1 
6. If S> ax and >> by both converge, prove each of the following: 
k=1 k=1 


a. >> cax converges for all cE R. 


k= 
7. If So (ax + b,%) converges, does this imply that the series 
a1 +b; +a2+b2+--- converges? 
8. Suppose by > ax > 0 for all kK EN. 


co co 
a. If > be converges, prove that S~ ax converges. 
k=1 k=1 


b. If S* ax diverges, prove that }5> bx diverges. 
k=1 k=1 


; wl 
9. Consider the series p> aa peER. 
k=1 


a. Prove that the series diverges for all p < 1. 


b. Prove that the series converges for all p > 1. 


Notes 


This chapter provided our first serious introduction to the limit process. In subse- 
quent chapters we will encounter limits of functions, the derivative, and the integral, 
all of which are further examples of the limit process. Of the many results proved 


124 Introduction to Real Analysis 


in this chapter, it is difficult to select one or two for special emphasis. They are all 
important! Many of them will be encountered again—either directly or indirectly— 
throughout the text. 

Some of the concepts and results of this chapter have certainly been encountered 
previously; others undoubtedly are new. Two concepts which may not have been 
previously encountered are limit superior (inferior) of a sequence of real numbers and 
complete metric spaces. The primary importance of the limit superior and inferior 
of a sequence is that these two limit operations always exist in RU {—oo, oo}. As we 
will see in Chapter 7, this will allow us to present the correct statements of the root 
and ratio test for convergence of a series. The limit superior will also be required to 
define the radius of convergence of a power series. There will be other instances in 
the text where these two limit operations will be encountered. 

In the chapter we have proved several important consequences of the least up- 
per bound property of R. The least upper bound property was used to prove that 
every bounded monotone sequence converges. This result was subsequently used to 
prove the nested intervals property, which in turn can be used to provide a proof 
of the Bolzano-Weierstrass theorem. The nested intervals property can also be used 
to prove the supremum property of R (Exercise 21 of Section 3.3). Another prop- 
erty of the real numbers that is equivalent to the least upper bound property is the 
completeness property of IR; namely, every Cauchy sequence of real numbers con- 
verges. Other consequences of the least upper bound property will be encountered 
in subsequent chapters. 

Cauchy sequences were originally studied by Cantor in the middle of the nine- 
teenth century. He referred to them as “fundamental sequences” and used them in 
his construction of the real number system R (See Miscellaneous Exercises 4 — 11). 
The main reason that these sequences are attributed to Cauchy, rather than Cantor, 
is due to the fact that his 1821 criterion for convergence of a series (Theorem 3.7.3) is 
equivalent to the statement that the sequence of partial sums is a Cauchy sequence. 
The fact that Cauchy was a more prominent mathematician than Cantor may also 
have been a factor. 


Miscellaneous Exercises 


The first three exercises involve the concept of an infinite product. Let {ax} bea 
sequence of nonzero real numbers. For each n = 1, 2,..., define 


If p= lim py exists, then p is the infinite product of the sequence {a;}?2,, and 
n—-oco 


p= II Ak. 
k=1 


If the limit does not exist, then the infinite product is said to diverge. 


we write 


Remark. Some authors require that p #4 0. We will not make this requirement; 
rather we will specify p # 0 if this hypothesis is required in a result. 
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1. Determine whether each of the following infinite products converge. If it 
converges, find the infinite product. 


a. Tl» b. I (1 = i): c. I (1 = z): 


k=2 
2. If II ak = p with p 4 0, prove that lim a, = 1. 
rast k—- oo 


3. If an > 0 for all n € N, prove that 
T1.,0. + ax) converges if and only if S072, ax converges. 
To prove the result, establish the following inequality: 
ait: +an < (1 +ar1)--*(1 tan) < et tam, 


Construction of the Real Numbers 


In the following exercises we outline the construction of the real num- 
ber system from the rational number system using Cantor’s method of 
Cauchy sequences. Let Q denote the set of rational numbers. A sequence 
{an} in Q is Cauchy if for every r € Q, r > 0, there exists a positive 
integer nm. such that jan —am| <r for alln, m > no. A sequence {ay} in 
Q is called a null sequence if for every r € Q, r > 0, there exists a pos- 
itive integer no such that |an| < r for all n > n.. Two Cauchy sequences 
{an} and {b,} in Q are said to be equivalent, denoted {an} ~ {bn}, 
provided {an — bn} is a null sequence. 

4. Let {an}, {bn}, {en}, and {dn} be Cauchy sequences in Q. Prove the 
following: 
a. {an} ~ {an}. 
b. If {an} ~ {bn}, then {bn} ~ {an}. 
c. If {an} ~ {bn} and {bn} ~ {cen}, then {an} ~ {en}. 
d. If {an} ~ {bn}, then {—an} ~ {—bn}. 
e. If {an} ~ {cen} and {bn} ~ {dn}, then 


{an + bn} ~ {en + dn} and {anbn} ~ {endn}. 


Given a Cauchy sequence {an} in Q, let [{an}] denote the set of all 
Cauchy sequences in Q equivalent to {an} . The set [{an}] is called the 
equivalence class determined by {an }. 

5. Given two Cauchy sequences {a,} and {b,} in Q, prove that [{an}] = 
[{bn }] provided {an} ~ {bn}, and [{an}] N [{bn}] = 0 otherwise. 


Let R denote the set of equivalence classes of Cauchy sequences in Q. We 
denote the elements of R by lower case Greek letters a, 6, y,.... Thus if 
a € R, a = [{an}] for some Cauchy sequence {an} in Q. The sequence 
{an} is called a representative of the equivalence class a. Suppose a = 
[{an}] and 6 = [{b,}]. Define —a, a+ 8, and a: 6 as follows: 


—a = [{-an}], 
a+ B= [{an + bn}], 
a: 8 = [{anbn}}. 
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One needs to show that these operations are well defined; that is, inde- 
pendent of the representative of the equivalence class. For example, to 
prove that —a is well defined, we suppose that {a,} and {b,} are two rep- 
resentatives of a; i.e., {an} ~ {bn}. But then by 4(d), {-—an} ~ {—bn}. 
Therefore, [{—an}] = [{—bn}]. This shows that —a is well defined. 


6. Prove that the operations + and - are well defined on R. 


For each p € Q, let {p} denote the sequence all of whose terms are equal 
to p. If p € Q, let ap = [{p}]. Also, we set 


O=[{0}], + =[{1})- 


As we will see, the element 6 will be the zero of R and v will be the unit 
of R. A Cauchy sequence {bn} in Q belongs to @ if and only if bn > 0. 
Similarly, {a,} € e if and only if (a, — 1) — 0. The following problem 
provides us with the multiplicative inverse of a 4 0. 


7. Ifa, prove that there exists {an} € a such that a, 4 0 for alln EN, 
and that {i} is a Cauchy sequence. Define a~t = [{<-}]- 


8. Prove that R with operations + and - is a field. 


We now proceed to define an order relation on R. A Cauchy sequence 
{an} in Q is positive if there exists r € Q, r > 0, and no € N such that 
arn > for alln > no. Let P be defined by 
P = {[{an}] : {an} is a positive Cauchy sequence }. 

9. Prove that the set P satisfies the order properties (O1) and (O02) of 
Section 1.4. 

10. Show that the mapping p — ay» is a one-to-one mapping of Q into Rk 
which satisfies 


Op + Ag = Ap+q 


Ap * Aq = pg 


for all p,q € Q. Furthermore, if p > 0, then ap € P. 


11. Prove that every nonempty subset of # which is bounded above has a 
least upper bound in R. 


The above exercises prove that R is an ordered field which satisfies the least 
upper bound property. One can show that any two complete ordered fields are in 
fact isomorphic, that is, there exists a one-to-one map of one onto the other which 
preserves the operations of addition, multiplication, and the order properties. Thus 
R is isomorphic to the real numbers R. 
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Limits and Continuity 


The concept of limit dates back to the late seventeenth century and the work 
of Isaac Newton (1642-1727) and Gottfried Leibniz (1646-1716). Both of 
these mathematicians are given historical credit for inventing the differential 
and integral calculus. Although the idea of “limit” occurs in Newton’s work 
Philosophia Naturalis Principia Mathematica of 1687, he never expressed the 
concept algebraically; rather he used the phrase “ultimate ratios of evanescent 
quantities” to describe the limit process involved in computing the derivatives 
of functions. 

The subject of limits lacked mathematical rigor until 1821 when Augustin- 
Louis Cauchy (1789-1857) published his Cours d’Analyse in which he offered 
the following definition of limit: “If the successive values attributed to the 
same variable approach indefinitely a fixed value, such that finally they differ 
from it by as little as desired, this latter is called the limit of all the others.” 
Even this statement does not resemble the modern delta-epsilon version of 
limit given in Section 1. Although Cauchy gave a strictly verbal definition of 
limit, he did use epsilons, deltas, and inequalities in his proofs. For this reason 
Cauchy is credited for putting calculus on the rigorous basis with which we 
are familiar today. 

Based on the previous study of calculus, the student should have an in- 
tuitive notion of what it means for a function to be continuous. This most 
likely compares to how mathematicians of the eighteenth century perceived 
a continuous function; namely one that can be expressed by a single formula 
or equation involving a variable x. Mathematicians of this period certainly 
accepted functions that failed to be continuous at a finite number of points. 
However, even they might have difficulty envisaging a function that is contin- 
uous at every irrational number and discontinuous at every rational number 
in its domain. Such a function is given in Example 4.2.2(g). An example of an 
increasing function having the same properties will also be given in Section 4 
of this chapter. 

In Section 1 we define the limit at a point of a real-valued function defined 
on a subset of a metric space, and provide numerous examples to illustrate this 
idea. In Sections 2 and 3 we consider the closely related theory of continuity 
and investigate some of the consequences of this very important concept. 
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4.1 Limit of a Function 


The basic idea underlying the concept of the limit of a function f at a point 
p is to study the behavior of f at points close to, but not equal to, p. We 
illustrate this with the following simple examples. Suppose that the velocity 
v (ft/sec) of a falling object is given as a function v = v(t) of time t. If the 
object hits the ground in ¢t = 2, then v(2) = 0. Thus to find the velocity at the 
time of impact, we investigate the behavior of u(t) as t approaches 2, but is 
not equal to 2. Neglecting air resistance, the function v(¢) is given as follows: 


—32t 0<t<2 
v(t) = ae 
0, ESO: 


Our intuition should convince us that v(t) approaches —64 ft/sec as t ap- 
proaches 2, and that this is the velocity upon impact. 

As another example, consider the function f(z) = «sin+, x 4 0. Here the 
function f is not defined at « = 0. Thus to investigate the behavior of f at 0 
we need to consider the values f(x) for x close to, but not equal to 0. Since 


If(z)| = |esin 5| < |e 


for all « 4 0, our intuition again should tell us that f(x) approaches 0 as x 
approaches 0. This indeed is the case as will be shown in Example 4.1.10(c). 

We now make this idea of f(x) approaching a value L as x approaches a 
point p precise. In order that the definition be meaningful, we must require 
that the point p be a limit point of the domain of the function f. 


DEFINITION 4.1.1 Let (X,d) be a metric space, E be a subset of X and 
f a real-valued function with domain E. Suppose that p is a limit point of E. 
The function f has a limit at p if there exists a number L € R such that given 
any € > 0, there exists ad > 0 for which 


|f(@) -Ll<e 
for all points x € E satisfying 0 < d(x,p) < 6. If this is the case, we write 


lim f(x) =D or f(a) 9 L as xp. 


xp 
Although we restricted our consideration to the case where f is a real- 
valued function, we could just as easily have considered the case where f has 
values in a metric space (Y,p). The extension to f : HE — Y is obtained by 
replacing | f(x) — L| with p(f(x), L), where in this case L is an element of Y. 
The definition of the limit of a function can also be stated in terms of € 
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and 6 neighborhoods as follows: If E Cc X, f : E > R, and p is a limit point 
of EF, then 
lim f(z) = L 


rp 
if and only if given € > 0, there exists a 6 > 0 such that 
f(e)EN(L) forall 2 € EA(Ns(p)\ {p}). 


This is illustrated graphically in Figure 4.1 for the case where EF is a subset 
of R. 


FIGURE 4.1 
lim f(#) = L 
2p 


Remarks. (a) In the definition of limit, the choice of 6 for a given € may 
depend not only on ¢€ and the function, but also on the point p. This will be 
illustrated in Example 4.1.2(f) below. 

(b) If p is not a limit point of £, then for 6 sufficiently small, there do not 
exist any x € E so that 0 < |a — p| < 6. Thus if p is an isolated point of F, 
the concept of the limit of a function at p has no meaning. 

(c) In the definition of limit, it is not required that p € FE, only that p is 
a limit point of E. Even if p € E, and f has a limit at p, we may very well 
have that 

lim f(x) # f(p). 
wp 


This will be the case in Example 4.1.2(b) below. 


(d) Let E CR and pa limit point of E. To show that a given function f 
does not have a limit at p, we must show that for every L © R, there exists 
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an € > 0, such that for every 6 > 0, there exists an « € E with 0 < |x—p| <0, 
for which 
|f(w) -— L| >. 


We will illustrate this in Example 4.1.2(d). 
EXAMPLES 4.1.2 (a) For x 4 2, let f(a) be defined by 


2 
—4 

eS gs 
x—2 


The domain of f is E = (—co, 2) U (2,00), and 2 is clearly a limit point of F. 
We now show that lim, f(a) =4. For « 2, 
one 


x?—4 
xr—2 


al =|e 42-4] =|e- 3) 


Thus given € > 0, the choice 6 = € works in the definition. 
(b) Consider the following variation of (a). Let g be defined on R by 
g?—4 
g(x) = x— 2° 
2 


x F 2, 


; x= 2. 


For this example, 2 is a point in the domain of g, and it is still the case that 
lim g(x) = 4. However, the limit does not equal g(2) = 2. The graph of g is 
2 


given in Figure 4.2. 


B(x), x #2 


9 (2 8(2)) 


FIGURE 4.2 
Graph of g 


(c) Let & = (—1,0) U (1, 00). For x € EF, let h(x) be defined by 


A(x) = Vere s. a £0. 


x 
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We claim that lim h(a) = 1/2. This result is obtained as follows: For x 4 0, 
x 


Ver la1. _ Je+l—-1\ (VeFli+1 _ x = 1 
x ( r )) a(Ve+it+1) vVe+1+1 


From this last term we now conjecture that h(x) > 1/2 as « > 0. By the 
above, 


nie) 4 | 1 4 Wat 
av = = 
2 Vc+1+1 2 2(/z2+1+41) 
. ee =| -—2£ 
7 2(/r+1+1)? [27a +141)? 
af |x| 
2 (ve+14+1)?" 
For x € E we have (/x+1+1)? > 1, and thus 
1] _ |e 


and thus lim, h(x) = 1/2. 
a 
(d) Let f be defined on R as follows: 


1, x € Q, 
f(z) = 
0, ct€éQ. 
We will show that for this function, lim f(a) fails to exist for every p € R. 
“Lp 
Fix p € R. Let LD © R and let 


€ = max{|L — 1], |Z]}. 


Suppose ¢ = |£ — 1]. By Theorem 1.5.2, for any 6 > 0, there exists an x € Q 
such that 0 < |p — z| < 6. For such an a, 


f(a) -L|=|l-Ll =e. 


If « = |L|, then by Exercise 6, Section 1.5, for any 6 > 0, there exists an 
irrational number x with 0 < |a—p| < 6. Again, for such an 2, | f(x) — L| =e. 
Thus with ¢ as defined, for any 6 > 0, there exists an x with 0 < |a — p| < 6 
such that | f(a) — L| > €. Since this works for every L € R, bus f(x) does not 


exist. 
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(e) Let f : R—- R be defined by 


7 0, «rEQ, 
ne) = | heer 


Then lim f(x) = 0. Since |f(x)| < |x| for all x, given « > 0, any 6,0 <6 <e, 
2 
will work in the definition of the limit. A modification of the argument given 
in (d) shows that for any p 4 0, lim f(x) does not exist. An alternate proof 
@—p 


will be provided in Example 4.2.2(b) 


(f) This example shows dramatically how the choice of 6 will in general 
depend not only on €, but also on the point p. Let F = (0,1) andlet f: ER 
be defined by 


1 
f(z) = z 

We will prove that for p € (0, 1], 
lim — = — 


If x > p/2, then 


p\- 


Therefore, given « > 0, let 6 = min{p/2,p*e/2}. Then if 0 < |x — p| < 6, 
x > p/2, and 


The 6 as defined depends both on p and e. This suggests that any 6 that works 


for a given p and e must depend on both p and e. Suppose on the contrary 
that for a given € > 0 the choice of 6 is independent of p € (0,1). Then with 
€ = 1, there exists a 6 > 0 such that 


for all x,p € (0,1) with 0 < |x — p| < 6. Since any smaller 6 will also work, 

we can assume that 0 <6 < s. But now if we take p = 36 and x = 0, then 
0 < |x — p| < 6 and thus 

1 2 1 

= ay ieee erates 

ee) -1@)|= [5-5] = 5 > 


This contradiction proves that the choice of 6 must depend on both p and e. 
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(g) For our final example we consider the function f defined on R? \ (0,0) 
given by f(x,y) = ety We will prove that the limit po tg flay) = 2, 
Consider 

2 Say — 2a? — 2y? 
_| = wy — 2) + (4y — 20)(@- 1) 
5(x? + y?) 
e (al+ 2lyDly = 21 + Alyl + 2la))|e = 1 
= 5(x? + y? ; 


If (x,y) € Na(1,2), then $< |x| < 2 and 3 < |y| < 3. (Verify!) Therefore for 
(x,y) € Ni (1,2) we have |x|+2|y| < 48, 4|y|+2|a| < 28, and 5(2?+y?) > 2. 
Therefore 


2 26 
2| 4 1}). 
ree) - 3] < Blly—21 + fea 
Hence if 6 is chosen so that 0 < 6 < 4, then for (2, y) € N5(1,2) we have 
2 
i eee 
flew) | <3 


Thus given € > 0, if we choose 6 such that 0 < 6 < min{3, 3e}, then (x,y) € 
N5(1, 2) implies that | f(x,y) — 2] <e. 


Sequential Criterion for Limits 


Our first theorem allows us to reduce the question of the existence of the limit 
of a function to one concerning the existence of limits of sequences. As we will 
see, this result will be very useful in subsequent proofs, and also in showing 
that a given function does not have a limit at a point p. 


THEOREM 4.1.3 Let E be a subset of a metric space X, p a limit point of 
E, and f a real-valued function defined on E. Then 


lim f(z) =L if and only if dim, f(pn) =L 
for every sequence {pn} in E, with pn, 4p for alln, and lim py, = p. 
noo 


Remark. Since p is a limit point of £, Theorem 3.1.4 guarantees the existence 
of a sequence {p,,} in F with p, 4 p for all n € N and p, > p. 

Proof. Suppose lim f(x) = L. Let {p,} be any sequence in FE with p, 4 p 
for all n and p, en si Let € > 0 be given. Since lim f(x) = L, there exists a 
6 > 0 such that << 


\f(a) -L]<e forall re FE, 0<|x—pl <6. (1) 
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Since lim p, = p, for the above 6, there exists a positive integer n, such that 
noo 


0<|pn—pl<6 forall n>nj. 


Thus if n > no, by (1), |f(n) — L| < ¢. Therefore lim f(p,) = L. 
n—->co 


Conversely, suppose f(p,,) > L for every sequence {p,} in E with p, 4p 
for all n and p, — p. Suppose lim f(a) #4 L. Then there exists an « > 0 
<p 


such that for every 6 > 0, there exists an x € E with 0 < |a —p| < 6 and 
| f(a) — L| > «. For each n € N, take 6 = 1/n. Then for each n, there exists 
Pn € E such that 


1 
0< [pn —pl<— and |f(pn)—L| >. 


Thus py, — p, but {f(p,)} does not converge to L. This contradiction proves 
the result. 


An immediate consequence of the previous theorem is the following unique- 
ness theorem. 


COROLLARY 4.1.4 If f has a limit at p, then it is unique. 


Theorem 4.1.3 is often applied to show that a limit does not exist. If one 
can find a sequence {p,,} with p, — p, such that {f(p,)} does not converge, 
then lim f(z) does not exist. Alternately, if one can find two sequences {p,, } 

«Lp 


and {r,} both converging to p, but for which 


lim f(pn) # lim f(rn), 


noo 


then again lim f(#) does not exist. We illustrate this with the following two 
«wip 


examples. 


EXAMPLES 4.1.5 (a) Let E = (0,00) and f(x) = sin+, « € E. We use 
the previous theorem to show that 


be eae 
lim sin — 
x0 x 
. 2 
does not exist. Let Pn = Qn+)r Then 
Tr TT 


f (pn) = sin(2n + 1)= = (-1)”. 


wla 


Thus lim f(p,) does not exist, and consequently by Theorem 4.1.3, lim f(z) 
noo «Ls 


also does not exist. The graph of f(x) = sin + is given in Figure 4.3. 
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FIGURE 4.3 
Graph of f(x) = sin(1/x), x >0 


(b) As in Example 4.1.2(e) let 


0, reEQ, 
X; r€éQ. 


Suppose p € R, p 4 0. Since Q is dense in R, there exists a sequence {p,} C Q 
with p, # p for all n € N such that p, — p. Hence lim f(pn) = 0. On the 


other hand, since R \ Q is also dense in R, there exists a sequence {g,} of 
irrational numbers with g, > p. But then lim f(q,) = lim qn, = p. Thus 
noo noo 


since p 4 0, by Theorem 4.1.3 lim f(x) does not exist. 
zr—-p 


Limit Theorems 


THEOREM 4.1.6 Suppose E is a subset of a metric space X, f,g: E > R, 
and p is a limit point of E. If 


lim f(x) =A and lim g(x) = B, 


Lp zr—+p 
then 
(a) lim[f(2) + (a) = A+B, 
(b) Jim f(a)g(x) = AB, and 
fla) A 
(c) us ae) =>} provided B #0. 
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Proof. For (a) and (b) apply Theorem 4.1.3 and Theorem 3.2.1, respectively. 
We leave the details to the exercises (Exercise 11). 


Proof of (c). By (b) it suffices to show that 


il 1 


lim —~ =—. 
a3 g(x) B 
We first show that since B 4 0, g(a) 4 0 for all x sufficiently close to p, x # p. 


Take « = |B|/2. Then by the definition of limit, there exists a 6, > 0 such 


that BI 
lg(z) — B| < “5. 

for all x € E, 0 < |x — p| < 6,. By Corollary 2.1.4 |g(x) — B| > ||g(x)| — |B]|. 

Thus 

Bl _ BI 


By 
\g(@)| > |B|- St = S > 0 


for alla € E,0 < |x—p| <4. 


We can now apply Theorem 4.1.3 and the corresponding result for se- 
quences of Theorem 3.2.1. Let {p,} be any sequence in EF with p, > p 
and p, # p for all n. For the above 6;, there exists an no € N such that 
0 < |pn — p| < 6; for all n > no. Thus g(p,) 4 0 for all n > n,. Therefore by 


Theorem 3.2.1(c), 
1 1 


lim —~ = =. 

ne g(Pn)  B 
Since this holds for every sequence p,, > p, by Theorem 4.1.3, 
: 1 
lim —~=—. 

cp g(r) B 


The proofs of the following two theorems are easy consequences of Theo- 
rem 4.1.3 and the corresponding theorems for sequences (Theorems 3.2.3 and 
3.2.4). First however we give the following definition. 


DEFINITION 4.1.7 A real-valued function f defined on a set E is 
bounded on E if there exists a constant M such that |f(x)| < M for all 
Lee. 


THEOREM 4.1.8 Suppose E is a subset of a metric space X, p is a limit 
point of E, and f, g are real-valued functions on E. If g is bounded on E and 
lim f(x) = 0, then 
xp 

lim f(x)g(a) = 0. 


xp 


Proof. Exercise 12. 


Limits and Continuity 139 


THEOREM 4.1.9 Suppose E is a subset of a metric space X, p is a limit 
point of E, and f, g, h are functions from E into R satisfying 


g(x) < f(x) < h(a) forall we EL. 


Tf lim g(a) = lim h(x) =L, then lim f(x) = 
rp rp rp 


Proof. Exercise 13. 


We now provide examples to illustrate the previous theorems. 


EXAMPLES 4.1.10 (a) Using mathematical induction and Theorem 
4.1.6(b), lima” = c” for all n € N. If p(x) = ana" +--+ + aya + ay is 
«wc 
a polynomial function of degree n, where n is a nonnegative integer and 
Ao, 4,-..,4, € Rwitha, 4 0, then a repeated application of Theorem 4.1.6(a) 
gives lim p(x) = p(c). 
wc 
(b) Consider 
: x + 2x? — 2a —4 
pares 2 —4 : 


By part (a), lim (2? + 2”? — 2x —4) = 0 and lim (x? — 4) = 0. Since the 
xr—>—2 w—>—2 


denominator has limit zero, Theorem 4.1.6(c) does not apply. In this example 
however, for x #4 —2 


ge+2a7-Qe@—-4 (x+2)(27-2) 27-2 


xg? —4 (x + 2)(x — 2) r—2Q- 


Since lim, (a —2) = —4 which is nonzero, we can now apply Theorem 4.1.6(c) 
xr — 
to conclude that 
x> + 2x7 — 22 —4 i x2 —2 1 


lim = lim a 
¢~——2 g2— 4 27-2 e¢—2 2 


(c) Let HE =R \ {0}, and let f : EH > R be defined by 
2 al 
f(x) =a sin. 


Since | sin(1/z)| <1 for alla € R, x 40 and lim @ = 0, by Theorem 4.1.8 
I 
lim a sin = = 0. 
«2-0 x 


The graph of f(x) = x sin 4 is given in Figure 4.4. 
(d) Let E = (0, 0) and let f be defined on E by 
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FIGURE 4.4 
Graph of f(x) = asin(1/x), « £0 


We now prove that 


sint 


lim 


t>0 «ot 


1. 


As we will see in the next chapter, this limit will be crucial in computing the 
derivative of the sine function. From Figure 4.5, we have 


area (AOPQ) < area (sector OPR) < area (AORS). 


In terms of t, this gives 
Lg t t< ty < ! tant 
= sint cos = — tant. 
2 2 2 


Therefore . 
eZ sin t 2 1 
cos — < —. 
t cost 


Using the fact that lim cost = 1 (Exercise 5), by Theorem 4.1.9 we obtain 
= 


i ea 
too «6 
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FIGURE 4.5 
Triangles and sector of Example 4.1.10(d) 


Limits at Infinity 


Up to this point we have only considered limits at points p € R. We now 

extend the definition to include limits at co or —oo. The definition of the 

limit at co is very similar to lim f(n) where f : N —> R; that is, f isa 
noo 


sequence in R. 


DEFINITION 4.1.11 Let f be a real-valued function such that Dom f M 
(a,oo) £0 for everya ER. The function f has a limit at oo if there exists 
a number L € R such that given € > 0, there exists a real number M for which 


|f(@)-Ll<e 
for allx € Dom f 1 (M, ov). If this is the case, we write 


lim f(a) = L. 


«LOO 
Similarly, if Dom f M (—o0, b) #0 for every bE R. 


lim f(#)=L 


xw—-—Co 
if and only if given € > 0, there exists a real number M such that 
|f(@) - Ll <e 


for all x € Dom f N(—co, M). 
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The hypothesis that Dom f M (a,co) 4 @ for every a € R is equivalent to 
saying that the domain of the function f is not bounded above. If Dom f =N, 
then the above definition gives the definition for the limit of a sequence. The 
reader should convince themself that all theorems up to this point involving 
limits at a point p € R are still valid if p is replaced by co or —co. 


EXAMPLES 4.1.12 (a) As our first example, consider the function 


sin xz 


f(x) 


ax 


defined on (0,00). Since | sinz| < 1, 


Ble 


If(z)| S 


for all x € (0,00). Let € > 0 be given. Then with M = 1/e, 


If(z)| <e 


Therefore, lim 
Zoo 6 6f 


(b) For our second example consider f(x) 


(n+ 5),n EN, then 


forall xa>WM. 


xsinaaz. If we set py = 


F (Pn) = (n+ 5) sin(n + 5)m = (-1)"(n + 5). 


Thus the sequence {f(py)}°2 


lim xsin7zax does not exist. 
xL->00 


Exercises 4.1 


1. 
*a. lim (2x — 7) = —3. 
L—2 


Nl Re 


*c, lim 
z>11 +2 


wed 
lim 
e—>—1 g+l 


*e, = 3. 


a. limc=c 
xL—>p 


*c. lim 2? =p 
rp 


*e. lim Vx = vp, 


x@L—p 


R. Justify your answer! 


*e. lim cos — 


x0 x ‘ 
1)*-1 
*e, lim (e@+1)"-1 
x20 4 68 


n 


p>d 


, is unbounded, and as a consequence 


Use the definition to establish each of the following limits. 


b. lim (3a +5) =—-1 
xL+>—2 


d. lim 27? —37—4=1. 
27-1 


3 a aces 
in = 
x2 a2 —4 


5 


Use the definition to establish each of the following limits. 


b. lim x = p. 
xp 

d. lim 2” = p", nEN 
xp 

Yi OT te 
xp x 2,/p 


For each of the following, determine whether the indicated limit exists in 


aed 


Bie 
xl z+l 


1 
|a| cos —. 
x 


fj v* — 2x7 +1 
. lim —————_ 
rol ag —g72-x+1 


d. lim 
x0 
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4. 


10. 


11. 


12. 
13. 
14. 


*Define f : (—1,1) > R by 


2 
Bo — D2 
Set 
Determine the limit L of f at —1 and prove, using € and 6, that f has 
limit LZ at —1. 
*a. Using Figure 4.5, prove that | sin h| < |h| for all h ER. 
b. Using the trigonometric identity 1 — cosh = 2sin? 7 prove that 
(i) lim cosh = 1. 
h-0 
1—cosh 
Hi) li _ 
(ii) has h 
Let E be a subset of a metric space (X,d), p a limit point of EF, and 


f : E +R. Suppose there exists a constant M > 0 and L € R such that 
| f(x) — L| < Md(a,p) for all x € E. Prove that lim f(x) = L. 
xp 


0 


Suppose f: EH > R, pis a limit point of E, and lim f(x) = L. 
Zp 
*a. Prove that lim |f(x)| = |L]. 
“2p 
b. If in addition f(x) > 0 for all 2 € E, prove that lim \/f(x) = VL. 
2p 


*c. Prove that lim(f(x))” = L” for each n EN. 


Lp 
Use the limit theorems, examples, and previous exercises to find each of 
the following limits. State which theorem, examples, or exercises are used 
in each case. 


2 _ 32 AD 
*q. lim dav + 3x — 2 b. lim gia e +2 
zl a—-1 a2>—l1 g+l 
3/2 
te. | 32+1 d. 1 ja + 2| 
ol 2e+5 x——2 g+2 
$e ae VED Sail Le. f 
e. lim SA f. lim — ar fracl,/p|,p>0 
in 2 — 2| - 2 
*o. lim Uae h. lim |x — 2| — |x + 2I 
x0 T. x—>0 x 


*Suppose f : (a,b) > R, p € [a,b], and lim f(x) > 0. Prove that there 
2p 
exists a 6 > 0 such that f(x) > 0 for all x € (a,b) with 0 < |x — p| <6. 


Suppose F is a subset of a metric space (X,d), p is a limit point of EL, 
and f : E — R. Prove that if f has a limit at p, then there exists a 
positive constant M and a6 > 0 such that |f(a)| < M for alla € E,0< 
d(x,p) <6. 


a. Prove Theorem 4.1.6(a). 
b. Prove Theorem 4.1.6(b). 
*Prove Theorem 4.1.8. 
Prove Theorem 4.1.9. 


Let f, g be real-valued functions defined on EF C R and let p be a limit 
point of FE. 


*a. If lim f(x) and lim(f(x) + g(x)) exist, prove that lim g(x) exists. 
xZ—>p xz 


x2£—>p —p 
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b. If lim f(x) and lim(f(x)g(x)) exist, does it follow that lim g(x) 
Lp 2p Zp 
exists? 


15. Let E be a subset of a metric space, p a limit point of E. Suppose f is 
a bounded real-valued function on FE having the property that lim f(z) 
Lp 


does not exist. Prove that there exist distinct sequences {p,} and {qn} 

in E with pn > p and qr > p such that lim f(pn) and lim f(qn) exist, 
TOO noo 

but are not equal. 


16. *Let f be a real-valued function defined on (a,0o) for some a > 0. Define 
g on (0, +) by g(t) = f (4). Prove that 


lim f(z) =L ifand only if lim g(t) = L. 
2-00 t0 


17. Investigate the limits at oo of each of the following functions. 


2 — 
CCE = nas — 
Va — 2x 
*e. f(x) = Va? 4+a-2. f. so eae ore 
*g. f(x) =acos+ h. f(x) = xsin +. 


18. Let f : (a,co) + R be such that lim xf(x) = L where L € R. Prove 
that lim f(x) =0. oi 
2-400 
19. Let f:R—-R satisfy f(7+y) = f(x) + f(y) for allz,y ER. If lim f(x) 
exists, prove that 


a. lim f(x) =0, and _ b. lim f(x) exists for every p € R. 
“2 


Lp 


4.2 Continuous Functions 


The notion of continuity dates back to Leonhard Euler (1707-1783). To Euler, 
a continuous curve (function) was one that could be expressed by a single for- 
mula or equation of the variable x. If the definition of the curve was made up 
of several parts, it was called discontinuous. This definition was sufficient to 
convey the concept of continuity if we keep in mind that in Euler’s time math- 
ematicians were primarily only concerned with elementary functions; namely 
functions built up from the trigonometric and exponential functions, and in- 
verses of these functions, using algebraic operations and composition. 

The more modern version of continuity is due to Bernhard Bolzano (1817) 
and Augustin-Louis Cauchy (1821). Both men were motivated to provide a 
clear and precise definition of continuity in order to be able to prove the 
intermediate value theorem (Theorem 4.2.11). Cauchy’s definition of continu- 
ity was as follows: “The function f(x) will be, between two assigned values 
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of the variable x, a continuous function of this variable if for each value of 
x between these limits, the numerical [i.e. absolute value] of the difference 
f(x +a) — f(x) decreases indefinitely with w”'. Even this definition appears 
strange in comparison with the more modern definition in use today. Both 
Bolzano and Cauchy were concerned with continuity on an interval, rather 
than continuity at a point. 


DEFINITION 4.2.1 Let E be a subset of a metric space (X,d) and f a real- 
valued function with domain E. The function f is continuous at a point 
peEE, if for every «> 0, there exists a 6 > 0 such that 


If(z) — fl <e 


for alla € E with d(a,p) < 6. The function f is continuous on EF if and 
only if f is continuous at every point p € E. 


The above definition can be rephrased as follows: A function f : FE > R is 
continuous at p € F if and only if given € > 0, there exists a 6 > 0 such that 


f(x) € N.(f(p)) for all x eE Ns(p)NE. 


This is illustrated on the real line in Figure 4.6. 


tA 0 2 em ee 
Nef(p)) f(P) 
S(p) - € Se 


FIGURE 4.6 
An illustration of Definition 4.2.1 


Remarks. (a) If p € E is a limit point of E, then f is continuous at p if and 
only if 


lim f(x) = f(p). 


rp 


lCauchy, Cours d’Analyse, p.43 
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Also, as a consequence of Theorem 4.1.3, f is continuous at p if and only if 


lim f(Pn) = f(P) 


n—->co 


for every sequence {p,} in E with p, > p. 


(b) If p € F is an isolated point, then every function f on E is continuous 
at p. This follows immediately from the fact that for an isolated point p of E, 
there exists a 6 > 0 such that N5(p) 1 E = {p}. 


We now consider several of the functions given in previous examples, and 
also some additional new examples. 


EXAMPLES 4.2.2 (a) Let g be defined as in Example 4.1.2(b), i-e., 


At the point p = 2, lim (2) = 44 g(2). Thus g is not continuous at p = 2. 
However, if we redefine g at p = 2 so that g(2) = 4, then this function is now 
continuous at p = 2. 

0, rEQ, 
, «&£¢Q> 


x 


(b) Let f be as defined in Example 4.1.2(e), ie. f(x) = 


Since 
lim f(e) = 0 = f(0), 
«2-0 
f is continuous at p = 0. On the other hand, since lim f(x) fails to exists for 
Lp 
every p #0, f is discontinuous at every p € R, p £ 0. 
1, rEQ, 


0, ZO of Example 4.1.2(d) 


(c) The function f defined by f(x) = 


is discontinuous at every p € R. 

(d) As in Example 4.1.2(f), the function f(x) = 1/2 is continuous at every 
p € (0,1). 

(e) Let f be defined by 


By Example 4.1.10(c), 
lim f(«) =0 = f(0). 


x0 


Thus f is continuous at x = 0. 
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(f) In this example, we show that f(x) = sina is continuous on R. Let 
z,y € R. Then 


If(y) — f(z) = |siny — sin | 
= 2|cos $(y + x) sin $(y — 2)| 
< 2|sin $(y — 2) |. 


By Exercise 5 of Section 4.1 | sinh| < |h|. Therefore 


f(y) — fl@)| <ly— al, 


from which it follows that f is continuous on R. 


(g) We now consider a function on (0,1) which is discontinuous at every 
rational number in (0,1) and continuous at every irrational number in (0, 1). 
For x € (0,1) define 


0, if x is irrational, 
z)=4 1 m 
F(z) -, if x is rational with = — in lowest terms. 
n n 


The graph of f, at least for a few rational numbers, is given in Figure 4.7. 


oe el e 

2 

ae 

ae ee e e 

4 

Fa te e e e e 

8 

ite e e e e e e e 

Se ‘Sk SURE Ms eS eek Sa SO 
ae ca ee ee ee ee ee ee 


FIGURE 4.7 
Graph of the function of Example 4.2.2(g) 


To establish our claim we will show that 


lim f(x) =0 


«rip 


for every p € (0,1). As a consequence, since f(p) = 0 for every irrational 
number p € (0,1), f is continuous at every irrational number. Also, since 
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f(p) #0 when p € QN (0,1), f is discontinuous at every rational number in 
(0,1). 
Fix p € (0,1) and let € > 0 be given. To prove that lim f(a) = 0 we need 
«2p 
to show that there exists a 6 > 0 such that 


If(2)| <e€ 
for all x € Ng(p)N (0,1), « # p. This is certainly the case for any irrational 


number x. On the other hand, if # is rational with 2 = “ (in lowest terms), 
then f(x) = +. Choose n, € N such that + < e. There exist only a finite 
number of rational numbers ™ (in lowest terms) in (0,1) with denominator 


less than nj. Denote these by rj, ..., 7m, and let 
6 = min{|r; — p| i =1,....m, ri A p}. 


Note, since p may be a rational number and thus possibly equal to r; for some 
i = 1,...,m, we take the minimum of {|r; — p|} only for those i for which 
r; #p. Thus 6 > 0 and if re QN Ns(p)N (0,1), r 4 p, with r = @ in lowest 
terms, then n > n,. Therefore, 


== <e. 


Thus |f(z)| < € for all x € Ns(p) 1 (0,1), x Ap. 


If f and g are real-valued functions defined on a set EF, we define the sum 
f+g, the difference f — g, and the product fg on E as follows: For z € E, 


(f + 9)(@) = fla) + g(a), 
(f — 9)(@) = f(x) — g(a), 
(f9)(@) = f(x)g(@). 


Furthermore, if g(a) 4 0 for all a € E, we define the quotient f/g by 


f f(x) 
(4) = 
g g(x) 
More generally, if f and g are real-valued functions defined on a set FE, the 


quotient f/g can always be defined on E; = {x € E:: g(x) 4 O}. 


As an application of Theorem 4.1.6 we prove that continuity is preserved 
under the algebraic operations defined above, 


THEOREM 4.2.3 If E is a subset of a metric space X and f,g: E> R 
are continuous at p € E, then 

(a) f+g and f —g are continuous at p, and 

(b) fg is continuous at p. 


(c) If g(a) 40 for alla € E, then f is continuous at p. 
g 
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Proof. If p is an isolated point of EF, then the result is true since every function 
on F is continuous at p. If p is a limit point of F, then the conclusions follow 
from Theorem 4.1.6. 


Composition of Continuous Functions 


In the following theorem we prove that continuity is also preserved under 
composition of functions. 


THEOREM 4.2.4 Let A,B C R and let f: A> Randg: Bo R 
be functions such that Range f C B. If f is continuous at p € A and g is 
continuous at f(p), thenh = go f is continuous at p. 


Proof. Let € > 0 be given. Since g is continuous at f(p), there exists a 6, > 0 
such that 


lov) —9(f(p))i<e€ forall ye BNNs, (f(p)). (2) 
Since f is continuous at p, for this 61, there exists a 6 > 0 such that 
f(x) — f(p)| < oy for all « € AN Ng(p). 
Thus, if z € A with |x — p| < 6, by (2) 
|h(x) — h(p)| = |9(F(%)) — 9(F(p))| <€. 


Therefore h is continuous at p. 


EXAMPLES 4.2.5 (a) If p is a polynomial function of degree n, that is 
P(z) = Anz” + Ay—12"-? +++» +412 + ao, 


where n is a nonnegative integer, do, ...,@, € R with a, 4 0, and Domp=R, 
then by Theorem 4.1.6 (a) and (b), p is continuous on R. 


(b) Suppose p and q are polynomials on R and E = {x € R: q(x) = 0}. 
Then by Theorem 4.1.6 the rational function r defined on R \ E by 


yak ceER\E£, 


is continuous on R \ E. 

(c) By Example 4.2.2(f), f(a) = sina is continuous on R. Hence if p is 
a polynomial function on R, by Theorem 4.2.4 (f o p)(a) = sin(p(x)) is also 
continuous on R. 


150 Introduction to Real Analysis 


Topological Characterization of Continuity 


Before considering several consequences of continuity, we provide a strictly 
topological characterization of a continuous function. In more abstract courses 
this is often taken as the definition of continuity. 


THEOREM 4.2.6 Let E be a subset of a metric space X and let f be a 
real-valued function on E. Then f is continuous on E if and only if f~'(V) 
is open in E for every open subset V of R. 


Proof. Recall (Definition 2.2.21) that a set U C E is open in E if for every 
p€U there exists a 6 > 0 such that Ns(p)N ECU. 

Suppose f is continuous on F and V is an open subset of R. If f-'(V) = 0 
we are done. Suppose p € f~!(V). Then f(p) € V. Since V is open, there exists 
€ > 0 such that N.(f(p)) C V. Since f is continuous at p, there exists a 6 > 0 
such that f(x) € N.(f(p)) for all « € Ns(p)N E; ie., Ns(p)N Ec f7l(V). 
Since p € f-+(V) was arbitrary, f~'(V) is open in E. 

Conversely, suppose f~1(V) is open in E for every open subset V of R. 
Let p € E and let € > 0 be given. Then by hypothesis f~' (N-(f(p))) is open 
in F. Thus there exists a 6 > 0 such that 


EQ Ns(p) c f~* (Ne(f(p))) ; 


that is, f(x) € N-(f(p)) for all « € Ns(p) 1 E. Therefore f is continuous at p. 


EXAMPLES 4.2.7 (a) We illustrate the previous theorem for the function 
f(x) = /z, Dom f = [0,00). Suppose first that V is an open interval (a,b) 
with a < b. Then 


0, b<0, 
f-'(V) = 4 (0,07), as0<b, 
Care Oe Oa: 


Clearly @ and (a?, b?) are open subsets of R and hence also of [0, 00). Although 
(0, b?) is not open in R, 
(0, b) =? (-0, b) N (0, oo). 


Thus by Theorem 2.2.23 [0,b?) is open in [0,0o). If V is an arbitrary open 
subset of R, then by Theorem 2.2.20 V = UJI,, where {J,,} is a finite or 


countable collection of open intervals. Since f~'(V) = U f~!(Un) (Theorem 


1.7.14) and each f~+(I;,) is open in [0, 00), f~1(V) is open in [0, 00). Therefore 
f(x) = Vz is continuous on [0, 00). 
(b) In this example, we show that if f : E — R is continuous on E and 
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V c Eis open in £, then f(V) is not necessarily open in Range f. Consider 
the function f : R—- R given by 


r= | a 


6-2, CSD, 


Then f is continuous on R and Range f = R (Exercise 10). However, 
f((—1,1)) = [0, 1), and this set is not open in R. 


Continuity and Compactness 


We now consider several consequences of continuity. In our first result we 
prove that the continuous image of a compact set is compact. In the proof of 
the theorem we only use continuity and the definition of a compact set. For 
subsets of R, an alternate proof using the Heine-Borel-Bolzano- Weierstrass 
theorem (Theorem 2.4.2) is suggested in the exercises (Exercise 25). 


THEOREM 4.2.8 If K is a compact subset of a metric space X and if 
f:K —>R is continuous on K, then f(K) is compact. 


Proof. Let {Va}aea be an open cover of f(A). Since f is continuous on K, 
f-1(V..) is open in K for every a € A. By Theorem 2.2.23, for each a there 
exists an open subset U, of X such that 


FO Vay Ie ie, 


We claim that {Ua}aea is an open cover of K. If p € K, then f(p) € f(K) 
and thus f(p) € Va for some a € A. But then p is in f~!(V,) and hence also 
in U,. Since each U,, is also open, the collection {Ua}aea is an open cover of 
K. Since K is compact, there exists a1,...,@, € A such that 


Rye |.) Us: 
j=l 
Therefore, 
KS Ua ck =| Ven) 
j=l j=l 


and by Theorem 1.7.14(a), 


f(K) =U fay). 


Since f(f> "(Va C Vass FR) C U V.,- Thus f(A’) is compact. 
j=l 


As a corollary of the previous theorem we obtain the following general- 
ization of the usual maximum-minimum theorem normally encountered in 
calculus. 
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COROLLARY 4.2.9 Let K be a compact subset of R and let f : K > R be 
continuous. Then there exist p,q © K such that 


f(a) < f(x) < fp) forall «eK. 


Proof. Let M = sup{f(x) : « € K}. By the previous theorem f(K) is 
compact. Thus, since f(A) is bounded, M < oo. Also, since f(K) is closed, 
M e€ f(K). Thus there exists p € K such that f(p) = M. Similarly for 
m = inf{f(x):a€ K}. 

We now provide examples to show that the result is false if kK C R is not 
compact; that is, not both closed and bounded. 


EXAMPLES 4.2.10 (a) Suppose £ is a subset of R. If EF is unbounded, 


consider 
2 


1 Te 


Then f is continuous on FE, sup{f(z) : « € E} = 1, but f(x) < 1 for all 
x € E. To see that the supremum is 1, we note that since E is unbounded, 
there exists a sequence {xz,} in EF such that 22 — oo as n > oo. But then 


=, 


ee ee 


Thus if 0 < 6 < 1, there exists an integer n such that f(a,) > 6. Hence 
sup{f(z):2¢€ E}=1. 
(b) If E is not closed, let x, be a limit point of E which is not in E. Then 


1 


g(x) = 1+ (@— a)? 


is continuous on E, with g(x) < 1 for all  € EF. A similar argument as above 
shows that sup{g(z): «2 € E} =1. 


Intermediate Value Theorem 


The following theorem is attributed to both Bolzano and Cauchy. Cauchy how- 
ever implicitly assumed the completeness of R in his proof, whereas the proof 
by Bolzano (given below) uses the least upper bound property. An alternate 
proof is outlined in the miscellaneous exercises. 


THEOREM 4.2.11 (Intermediate Value Theorem) Let f : [a,b] > R 
be continuous. Suppose f(a) < f(b). If y is a number satisfying 


f(a) <7 = FO), 


then there exists c € (a,b) such that f(c) = 7. 
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FIGURE 4.8 
Intermediate value theorem 


The statement and conclusion of the intermediate value theorem is illus- 
trated in Figure 4.8. The theorem simply states that if f is continuous on [a,b] 
with f(a) < f(b), and y € R satisfies that f(a) < y < f(b), then the graph of 
f crosses the line y = 7 at least once. 

Proof. Let A = {x € [a,b] : f(x) < y}. The set A 4 @ since a € A, and 
A is bounded above by b. Thus by the least upper bound property A has a 
supremum in R. Let c = sup A. Since b is an upper bound, c < b. 

We now show that f(c) = 7. Suppose f(c) < y. Then e = $(7— f(c)) > 0. 

Since f is continuous at c, for this € there exists a 6 > 0 such that 


f(c) —e< f(x) < fi +e for all x € Ns(c) N[a, }}. 


Since f(c) < y, c# b, and thus (c, 6] MN Ns(c) # @. But for any x € (c,b] with 
c<au<cto, 


1 


fla) < f) +e= f+ 57-5 f= SFO +9) <7. 


But then « € A and x > c¢ which contradicts c = sup A. Therefore f(c) > 7. 

Since c = sup A, either c € A or c is a limit point of A. If c € A, then 
f(c) < y. If c is a limit point of A, then by Theorem 3.1.4 there exists a 
sequence {z,} in A such that x, > c. Since x, € A, f(a@n) < y. Since f is 
continuous, 


f() = Jim fen) <7. 


Thus in either case, f(c) < y. Therefore f(c) = 7. 
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The intermediate value theorem is one of the fundamental theorems of 
calculus. Simply stated, the theorem implies that if J is an interval and f : 
I — R is continuous, then f(Z) is an interval. Due to the importance of this 
result we state it as a corollary. 


COROLLARY 4.2.12 Jf I CR ts an interval and f : I > R is continuous 
on I, then f(L) is an interval. 


Proof. Let s,¢t € f(Z) with s < t, and let a, b € I with a # b be such that 
f(a) = s and f(b) =t. Suppose ¥ satisfies s < y < t. Ifa < b, then since f is 
continuous on [a,b], by the intermediate value theorem theorem there exists 
c € (a,b) such that f(c) = y. Thus y € f(Z). A similar argument also holds if 
a> b. 


There is an alternate way to state the previous corollary using the ter- 
minology of connected sets. If J is a connected subset of R and f: J — R 
is continuous on J, then f(Z) is connected. This result can be proved using 
only properties of continuous functions and the definition of a connected set 
(Exercise 28). The corollary now follows from the fact that a subset of R 
is connected if and only if it is an interval (Theorem 2.2.25). The proof of 
Theorem 2.2.25 however also requires the least upper bound property of R. 
Consequently, the supremum property of the real numbers cannot be avoided 
in proving Corollary 4.2.12. 


The following two corollaries are additional applications of the intermedi- 
ate value theorem. Our first result is the proof of Theorem 1.5.3. 


COROLLARY 4.2.13 For every real number y > 0 and every positive in- 
teger n, there exists a unique positive real number y so that y” = ¥y. 


nm 


Proof. That y is unique is clear. Let f(a) = 2", which by Exercise 7 is 
continuous on R. Let a=0 and b=7+1. Since (y +1)" > 7, f satisfies the 
hypothesis of Theorem 4.2.11. Thus there exists y, 0 < y < y +1, such that 


f(y) =y" =7%. 


COROLLARY 4.2.14 Jf f : [0,1] > [0,1] is continuous, then there exists 
y € [0,1] such that f(y) = y. 


Proof. Let g(x) = f(x) — x. Then g(0) = f(0) > 0 and g(1) = f(1) -1 <0. 
Thus there exists y € [0,1] such that g(y) = 0; i-., f(y) = y. 
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EXAMPLES 4.2.15 (a) In the proof of Theorem 4.2.11 continuity of the 
function f was required. The following example shows that the converse of 
Theorem 4.2.11 is false; that is, if a function f satisfies the intermediate value 
property on an interval [a,b], this does not imply that f is continuous on [a, 6]. 
Let f be defined on [0, 2] as follows: 


1 
in— V<e< 4 
f(a) = sin — Ss 
—1, xr=0. 


Then f(0) = —1, f (4) = 1, and for every y, -1 < 7 < 1, there exists an 
x € (0, 2) such that f(#) = y. However, the function f is not continuous at 
x = 0 (see Figure 4.3). 

(b) In this example, we show that the conclusion of the intermediate value 
theorem is false if the interval [a, b] of real numbers is replaced by an interval 
of rational numbers. Let E = {2 € Q:0 <a < 2}, and let f(x) = x?. Then f 
is continuous on F with f(0) < 2 < f(2). However, there does not exist r € E 
such that f(r) = 2. 


Exercises 4.2 


1. For each of the following, determine whether the given function is con- 
tinuous at the indicated point ao. 


2a? — 5a —3 
a. f(x) = x-3 ? at % =3 
6, 3% 
Vr-—2 
b. h(z) =< x-4 are at tm = 4 
4 r=4 
1—cosx 
*c. g(x) = eT eo at % =0 
0, xz=0, 


2 <2 
*d k(x) = ae ee 
4-4, x> 2, 
2. Let f:R—R be defined by 
8x, when z is rational, 
f= 4, 9 one 
22° + 8, when z is irrational. 
a. Prove, using € and 6, that f is continuous at 2. 
*b. Is f continuous at 1? Justify your answer. 
3. Let f: R—R be defined by 
x”, rEQ, 
f(x) = 
a+ 2, crE€Q. 


Find all points (if any) where f is continuous. 
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10. 


11. 


12: 


13. 


14. 
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*Prove (without using Example 4.2.7) that f(a) = /z is continuous on 
[0, oo). 
— 1 fa#+i 
ofa x 
a. Justify that f is continuous on (0, 1]. 
*b. Can one define f(0) so that f is continuous on [0, 1]? 


Let E CR, and suppose f : E > R is continuous at p € E. 


Define f : (0,1) > R by f(a) 


*a. Prove that |f| is continuous at p. Is the converse true? 
b. Set g(x) = \/|fx)|. Prove that g is continuous at p. 
*Let E be a subset of a metric space X, and suppose f : EF —> R is 


continuous on E. Prove that f” defined by f”(x) = (f(x))” is continuous 
on £ for each n € N. 


*a. Prove that f(x) = cosz is continuous on R. 


b. If E C R and f : E > R is continuous on E, prove that g(x) = 
cos(f(x)) is continuous on EL. 


For each of the following equations, determine the largest subset E of R 
such that the given equation defines a continuous function on E. In each 
case state which theorems or examples are used to show that the function 
is continuous on EF. 


x + 4a —5 eM 

*a, f(x) => “a(a2—4) b. g(x) = sin a 
ee cig te ea 
e241 sin x 


x r<2 


? = 


* is continuous on R and that 


Prove that f(x) = to S55 
— a, x ’ 


Range f = R. 

As in Example 4.2.7, use Theorem 4.2.6 to prove that each of the following 
functions is continuous on the given domain. 

a. i@) = +, Dom f = (0, 00). b. g(x) = 2°, Domg=R. 

*a, Let f : R? > R® be defined by f(z, y) = («1 + y, x — y). Show that f 
is continuous on R?. 


b. Let FE be a subset of R, and suppose f,g are continuous real-valued 
functions on F. Prove that f(x,y) = (f(x), f(y)) is continuous on E x E. 


Prove that the function f defined on D = R?\ (0,0) by f(x,y) = aH 
is continuous and bounded on D. 


Suppose F is a subset of R and f,g : EF > R are continuous at p € E. 
Prove that each of the functions defined below is continuous at p. 


*a. max{f,g}(x) = max{f(x),g(z)}, «Ee EL. 
b. min{f,g}(x) = min{f(x),g(z)}, «wee. 
c. ft (x) = max{ f(z), 0}. 
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15. 
16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26. 


2: 


28. 


29. 


Prove that there exists x € (0, 4) such that cosa = a. 
*Use the intermediate value theorem to prove that every polynomial of 
odd degree has at least one real root. 


*Suppose f : [—1, 1] > R is continuous and satisfies f(—1) = f(1). Prove 
that there exists y € [0,1] such that f(y) = f(y —-1). 

Suppose f : [0,1] — R is continuous and satisfies f(0) = f(1). Prove that 
there exists y € [0, 4] such that f(y) = f(y + 4). 

*Let EC R and let f : E > R be continuous. Let F = {x € E: f(x) = 
0}. Prove that F is closed in E. Is F necessarily closed in R? 

Suppose f : (0,1) > R is continuous and satisfies f(r) = 0 for each 
rational number r € (0,1). Prove that f(x) = 0 for all « € (0,1). 

Let E C R and let f be a real-valued function on FE that is continuous 
at p € E. If f(p) > 0, prove that there exists an wa > 0 and a 6 > 0 such 
that f(x) > a for all « € Ns(p) NE. 


*Let f : E > R be continuous at p € E. Prove that there exists a positive 
constant M and 6 > 0 such that |f(a)| < M for all a € EN Ng(p). 


Let f : (0,1) + R be defined by 


m 


f(a) 0, if x is irrational, 
tz)= 
n, if x is rational with « = ™ in lowest terms. 


a. Prove that f is unbounded on every open interval I C (0,1). 


b. Use (a) and the previous exercise to conclude that f is discontinuous 
at every point of (0,1). 

Suppose F is a subset of R and f,g: E — R are continuous on FE. Show 
that {c © E: f(a) > g(x)} is open in E. 


*Let K be a compact subset of a metric space X and let f : K > R be 
continuous on K. Prove that f(K) is compact by showing that f(K) is 
closed and bounded. 


Let E C R and let f be a real-valued function on E. Prove that f is 
continuous on EF if and only if f~'(F) is closed in E for every closed 
subset F of R. 


Let A, B C R and let f : A— R and g: B > R be functions such that 
Range f C B. 


*a. If V CR, prove that (go f)~'(V) = f-'(g-'(V)). 


b. If f and g are continuous on A and B respectively, use Theorem 4.2.6 
to prove that go f is continuous on A. 


Suppose I is a connected subset of R and f : J — R is continuous on 
I. Prove, using only the properties of continuity and the definition of 
connected set, that f(I) is connected. 


*Let K be a compact subset of a metric space X, and let f be a real- 
valued function on K. Suppose that for each x € K there exists ez > 0 
such that f is bounded on Ne, (x) MK. Prove that f is bounded on K. 
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30. Let A C R. For p € R, the distance from p to the set A, denoted 
d(p, A) is defined by d(p, A) = inf{|p — z| : a € A}. 
a. Prove that d(p, A) = 0 if and only if p € A. 
b. For x,y € R, prove that |d(a, A) — d(y, A)| < |x — yJ. 
c. Prove that the function x — d(a, A) is continuous on R. 
d. If A, B are disjoint closed subsets of R, prove that 
d(z,A 
se) d(x, 5 cs ae B) 
is a continuous function on R satisfying 0 < f(x) <1 for all  € R, and 


0, xceA, 
ney={" xe B. 


31. Let f be a continuous real-valued function on R satisfying f(0) = 1 and 
f(a@t+y) = f(x)f(y) for all x,y € R. Prove that f(a) = a” for some 
a€R,a>O0. 


4.3 Uniform Continuity 


In the previous section we discussed continuity of a function at a point and on 
a set. By Definition 4.2.1, a function f : EF > R is continuous on E if for each 
p © E, given any € > 0, there exists a 6 > 0 such that | f(a) — f(p)| < € for all 
x € ENNs(p). In general, for a given € > 0, the choice of 6 that works depends 
not only on € and the function f, but also on the point p. This was illustrated 
in Example 4.1.2(f) for the function f(z) = 1/x, x € (0,1). Functions for 
which a choice of 6 independent of p is possible are given a special name. 


DEFINITION 4.3.1 Let E be a subset of a metric space (X,d) and f : 
ER. The function f is uniformly continuous on E if given € > 0, there 
exists ad > 0 such that 


f(x) — f(y)| <e for all x,yeE with d(a,y) <6. 


The key point in the definition of uniform continuity is that the choice 
of 6 must depend only on e¢, the function f, and the set E; it has to be inde- 
pendent of any x € E. To illustrate this, we consider the following examples. 


EXAMPLES 4.3.2 (a) If E is a bounded subset of R, then f(x) = 2? 
is uniformly continuous on E. Since F is bounded, there exists a positive 
constant C > 0 so that |x| < C for alla € E. If x, y € E, then 


f(x) — FY) = |x? —y*| = |e +ylle—yl < (lel +|yDle— 9! 
<2C|x— yl. 
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Let € > 0 be given. Take 6 = €/2C. If x, y € E with |x — y| < 6, then by the 
above 

|f(x) — fy)| < 2C |x —y| < 206 <e. 
Therefore f is uniformly continuous on F. In this example, the choice of 6 
depends both on ¢, and the set E. In the exercises you will be asked to show 
that this result is false if the set F is an unbounded interval. 


(b) Let f(x) =sinz. As in Example 4.2.2(f), 
If(y) — f@)| < ly- 2! 


for all x,y € R. Consequently, f is uniformly continuous on R. 

(c) In this example, we show that the function f(x) = 1/z, x € (0,1), is 
not uniformly continuous on (0, 1). Suppose on the contrary that f is uniformly 
continuous on (0,1). Then if we take « = 1, there exists a 6 > 0 such that 


for all x,y € (0,1) with |a — y| < 6. Since any smaller 6 will also work, we 
can assume that 5 < 1. Then for any x € (0,5), y = 2+ $6 is in (0,1) and 
satisfies |a — y| < 6. Thus 


Since z + $6 <1 for all x € (0,5), we have 


( 
$6 <a(x+36) <a. 


Thus x > 46 for all x € (0, 4) which is a contradiction. The function f(a) = 
1/x however is uniformly continuous on [a,0o) for any fixed a > 0 (Exercise 


A(a)). 


Lipschitz Functions 


Both of the functions in Example 4.3.2 (a) and (b) are examples of an extensive 
class of functions. If F is a subset of a metric space (X,d), a function f : E > 
R satisfies a Lipschitz condition on E if there exists a positive constant M 
such that 
f(z) — fl < Md(z,y) 

for all x, y € E. Functions satisfying the above inequality are usually referred 
to as Lipschitz functions. As we will see in the next chapter, functions for 
which the derivative is bounded are Lipschitz functions. As a consequence 
of the following theorem, every Lipschitz function is uniformly continuous. 
However, not every uniformly continuous function is a Lipschitz function. For 
example, the function f(x) = ./z is uniformly continuous on [0,00), but f 
does not satisfy a Lipschitz condition on [0,00) (see Exercise 5). 
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THEOREM 4.3.3 Suppose E is a subset of a metric space (X,d) and f : 
ER. If there exists a positive constant M such that 


lf(x) — f(y)| < Md(a, y) 


for all x, y € E, then f is uniformly continuous on E. 


Proof. Exercise 1. 


Uniform Continuity Theorem 


If the function f does not satisfy a Lipschitz condition on EF, then to determine 
whether f is uniformly continuous on F is much more difficult. The following 
theorem provides a sufficient condition on the set E such that every continuous 
real-valued function on F is uniformly continuous. 


THEOREM 4.3.4 If K is compact and f : K — R is continuous on Kk, 
then f is uniformly continuous on K. 


Proof. Let « > 0 be given. Since f is continuous, for each p € K, there exists 
a dp > 0 such that 


F(x) — Fe) < 5 (3) 


for all a € K Nz, (p). 
The collection {N5, /2(p) oee 


a finite number of these will cover AK. Thus there exist a finite number of 
points p,...,)n in K such that 


is an open cover of K. Since K is compact, 


K CUNG,, /2(1). 


i=l 


Let 
bap minfonete = leash. 


Then 6 > 0. Suppose 2, y € K with d(a,y) < 6. Since x € K, x € Ng, /2(pi) 
for some i. Furthermore, since d(x,y) <6 < dp,/2, 


at, y € No,, (pi). 
Thus by the triangle inequality and (3), 


|f(z) — FY) < IF (@) — F(pa)| + fi) — FY) < ge+ ge=€. 


COROLLARY 4.3.5 A continuous real-valued function on a closed and 


bounded interval |a, b] is uniformly continuous. 
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The definition of uniform continuity as well as the proof of Corollary 4.3.5 
appeared in a paper by Eduard Heine in 1872. 


EXAMPLE 4.3.6 In this example, we show that both the properties closed 
and bounded are required. The interval [0, 00) is closed, but not bounded. The 
function f(x) = x? is continuous on [0,0o), but not uniformly continuous on 
(0, co) (Exercise 2). On the other hand, the interval (0,1) is bounded, but not 
closed. The function f(a) = 1/az is continuous on (0,1), but f is not uniformly 
continuous on (0, 1). 


Exercises 4.3 


1. Prove Theorem 4.3.3. 


2. Show that the following functions are not uniformly continuous on the 
given domain. 


*a. f(x) = 2°, Dom f = (0,00) b. g(x) = cs Dom g = (0, co) 
*c. h(x) = sin *, Domh= (0,00) d. k(x) = —_ Dom k = (0,7) 


3. Prove that each of the following functions is uniformly continuous on the 
indicated set. 


*a, f@)= > x € [0, 00) b. g(x) =2?, «EN. 
*c. h(x) = , «eR. d. k(x) =cosz, «ER 
z4+1 
x sin x 
e. e(x) = sagt € (0, co) *f. f(x) = 7? Ee (0, 1) 


4. Show that each of the following functions is a Lipschitz function. 
*a. f(x) = =; Dom f = [a,co), a > 0. 


x 
b. g(x) = Poe 


*c. h(x) = sin a Dom h = [a, co), a > 0. 


Dom g = [0, 00). 


d. p(x) a polynomial, Domp = [—a,a], a> 0. 


5. *a. Show that f(x) = ./@ satisfies a Lipschitz condition on [a, oo), 
a>0. 


b. Prove that \/z is uniformly continuous on [0,0o) . 
*c. Show that f does not satisfy a Lipschitz condition on [0, 00). 
6. Suppose FC R and f,g are Lipschitz functions on EF. 
a. Prove that f +g is a Lipschitz function on EF. 


b. If in addition f and g are bounded on EF, prove that fg is a Lipschitz 
function on E. 


7. Suppose & CR, and f, g are uniformly continuous real valued functions 
on E. 


a. Prove that f +g is uniformly continuous on EF. 
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*b. If in addition f and g are bounded, prove that fg is uniformly con- 
tinuous on FE. 


c. Is (b) still true if only one of the two functions is bounded? 

8. Suppose FE is a subset of a metric space X and f : FE > R is uniformly 
continuous. If {a} is a Cauchy sequence in E, prove that {f(rn)} is a 
Cauchy sequence. 

9. Let f : (a,b) — R be uniformly continuous on (a,b). Use the previous 
exercise to show that f can be defined at a and b such that f is continuous 
on [a, b] 

10. *Suppose that FE is a bounded subset of R and f : E > R is uniformly 
continuous on EF. Prove that f is bounded on FE. 

11. Suppose —co <a<c<b< oo, and suppose f : (a,b) > R is continuous 
on (a,b). 
a. If f is uniformly continuous on (a,c) and also uniformly continuous 
on (c,b), prove that f is uniformly continuous on (a, b). 
b. Show by example that the conclusion in (a) may be false if f is not 
continuous on (a, b). 


12. Let a € R. Suppose f is a real-valued function on [a,oo) satisfying 
lim f(2) = L, where L € R. Prove that 
xz—->0o 


*a. f is bounded on [a, oo), and 
b. f is uniformly continuous on [a, co) 


13. Let E C R. A function f : E — E is contractive if there exists a 
constant b, 0 < b < 1, such that | f(x) — f(y)| < bla — yl. 
*a. If E is closed, and f : E > E is contractive, prove that there exists 
a unique point x, € E such that f(x.) = xo. (Such a point x, is called a 
fixed point of f) 

b. Let E = (0, 5]. Show that f(x) = x? is contractive on E, but that f 

does not have a fixed point in FE. 

14. A function f : R > R is periodic if there exists p € R such that 
f(x +p) = f(a) for all z € R. Prove that a continuous periodic function 
on R is bounded and uniformly continuous on R. 


Da 


4.4 Monotone Functions and Discontinuities 


In this section, we take a closer look both at limits and continuity for real- 
valued functions defined on an interval J C R. More specifically however, 
we will be interested in classifying the types of discontinuities which such a 
function may have. We will also investigate properties of monotone functions 
defined on an interval J. These functions will play a crucial role in Chapter 6 
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on Riemann-Stieltjes integration. First however we begin with the right and 
left limit of a real-valued function defined on a subset EF of R. 


Right and Left Limits 


DEFINITION 4.4.1 Let E CR and let f be a real-valued function defined 
on FE. Suppose p is a limit point of EN (p,co). The function f has a right 
limit at p if there exists a number L € R such that given any € > 0, there 
exists ad > 0 for which 


|f(x) — L| <e for alla € E satisfying p <a <pto. 


The right limit of f, if it exists, is denoted by f(p+), and we write 


f(p+) = lim, f(x) = lim f (2). 
R=2R x>p 


Similarly, if p is a limit point of EM (—oco,p), the left limit of f at p, if it 
exists, is denoted by f(p—), and we write 


The hypothesis that p is a limit point of EM (p,co) guarantees that for 
every 6 > 0, EN(p,p+6) 4 0. If E is an open interval (a,b), -oo <<a<b<oa, 
then any p satisfying a < p < b is a limit point of EM (p,oo). Similarly, if 
-—oo <a <b < ow, then any p satisfying a < p < b is a limit point of 
(—oo, p) NE. If I is any interval with Int(/) 4 9, and f : J > R, then f has a 
limit at p € Int(JZ) if and only if 

(a)  f(p+) and f(p—) both exist, and 

(b)  f(pt+) = f(p-). 

The hypothesis that p € Int(J) guarantees that p is a limit point of both 
(—oo, p) NI and also I'M (p, oo). If p is a left end point of the interval J, then 
the right limit of f at p coincides with the limit of f at p. The analogous 
statement is also true if p is a right endpoint of J. 


We also define right and left continuity of a function at a point p as follows: 


DEFINITION 4.4.2 Let E CR and let f be a real-valued function on E. 
The function f is right continuous (left continuous) at p © E if for any 
€ > 0, there exists a 6 > 0 such that 


lf(z)-—f(p)| <e forallxec E withp<a<pt+od (p—d<a<p). 


Remarks. If p € F is an isolated point of E or is not a limit point of EN(p, oo), 
then there exists a 6 > 0 such that EN (p,p +6) =@. Thus if f : EH > R and 
€ > 0 is arbitrary, then | f(x) — f(p)| < e for all z € EN [p,p +). Thus every 
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f : E — R is right continuous at p. In particular, if F is a closed interval [{a, b], 
then every f : [a,b] > R is right continuous at b. Also, f is left continuous at 
b if and only if f is continuous at p. 

The following theorem, the proof of which is left to the exercises, is an 
immediate consequence of the definitions. 


THEOREM 4.4.3 A function f : (a,b) > R is right continuous at p € (a,b) 
if and only if f(p+) exists and equals f(p). Similarly, f is left continuous at 
p if and only if f(p—) exists and equals f(p). 


Proof. Exercise 1. 


Types of Discontinuities 


By the previous theorem a function f is continuous at p € (a,b) if and only if 
(a) f(p+) and f(p—) both exist, and 
(b) f(p+) = f(p—) = f(p). 

A real-valued function f defined on an interval I can fail to be continuous 


at a point p € I (the closure of J) for several reasons. One possibility is that 
lim f(a) exists but either does not equal f(p), or f is not defined at p. Such a 
zp 


function can easily be made continuous at p by either defining, or redefining, 
f at p as follows: 
f(p) = lim f(z). 


xr—-p 


For this reason, such a discontinuity is called a removable discontinuity. 
For example, the function 


of Example 4.2.2(a) is not continuous at 2 since 
lim g(x) = 4 # g(2). 
w—2 


By redefining g such that g(2) = 4, the resulting function is then continuous 
1 

at 2. Another example is given by f(a) = x sin—, x € (0,00), which is not 
x 

defined at 0. If we define f on [0, 00) by 


0, x=0, 
r)= 1 
F(a) xsin-, «>Q0, 
x 
then by Example 4.2.2(e), f is now continuous at 0. 


Another possibility is that f(p+) and f(p—) both exist, but are not equal. 
This type of discontinuity is called a jump discontinuity. (See Figure 4.9) 
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DEFINITION 4.4.4 Let f be a real valued function defined on an interval I. 
The function f has a jump discontinuity at p € Int(J) if f(p+) and f(p—) 
both exist, but f is not continuous at p. If p € I is a left (right) endpoint of 
I, then f has a jump discontinuity at p if f(p+) (f(p—)) exists, but f is not 
continuous at p. 


S(p+) 


S(p-) 


FIGURE 4.9 
Jump discontinuity of f at p 


Jump discontinuities are also referred to as simple discontinuities, or 
discontinuities of the first kind. All other discontinuities are said to be of 
second kind. 

If f(p+) and f(p—) both exist, but f is not continuous at p, then either 

(a) f(p+) A f(p—), or 

(b) f(pt+) = f(p—-) # flr). 

In case (a), f has a jump discontinuity at p, whereas in case (b), the discon- 


tinuity is removable. All discontinuities for which f(p+) or f(p—) does not 
exist are discontinuities of the second kind. 


EXAMPLES 4.4.5 (a) Let f be defined by 


vie) = | x, 0<a<il, 


3-27, x>1. 
Ifx <1, then f(a) = x. Therefore, 


f(1-) = lim f(x) = lim 2 =1= f(1). 


x21 
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Likewise, the right limit of f at 1 is 
a a WS wa pp es 
f(t) = mn, f(x) = lim 3 x = 2. 


Therefore f(1—) = f(1) = 1, and f(1+) = 2. Thus f is left continuous at 
1, but not continuous. Since both right and left limits exist at 1, but are not 
equal, the function f has a jump discontinuity at 1. 

(b) Let [xz] denote the greatest integer function, that is, for each x, 
[x] = largest integer n which is less than or equal to x. For example, [2.9] = 2, 
[3.1] = 3, and [—1.5] = —2. The graph of y = [2] is given in Figure 4.10. It is 
clear that for each n € Z, 


lim [tz] =n-1, and lim [a] =n. 
rn znt 
ee —— 
2-t o————Oo 
Ns ( ©) 
act taecancens wean: t 
-1 1 2 3 
—— +1 


FIGURE 4.10 
Graph of [2] 


Thus f has a jump discontinuity at each n € Z. Also, since f(n) = [n] = n, 
f(x) = [a] is right continuous at each integer. Finally, since f is constant on 
each interval (n — 1,n), n € Z, f is continuous at every « € R\ Z. 


(c) Let f be defined on R by 


0, ifz <0 
f(z) = 


1 
sin-, ifx>0. 
x 


Then f(0—) = 0, but f(0+) does not exist. Thus the discontinuity is of second 
kind. 
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(d) Consider the function g : R > R defined by 
g(x) = sin(272[z]). 


For « € (n,n +1),n € Z, 2[xz] = naz, and thus g(x) is continuous on every 
interval (n,n +1), n € Z. On the other hand, for n € Z, 
lim sin(27a[z]) = sin(27n”) =0, and 
zn 
lim sin(27a[z]) = sin(2mn(n — 1)) = 0. 
ran 
Since g(n) = sin(27n?) = 0, g is also continuous at each n € Z. The function 
g however, is not uniformly continuous on R (Exercise 7). 


Monotone Functions 


DEFINITION 4.4.6 Let f be a real-valued function defined on an interval 
I. 

(a) f is monotone increasing (increasing, nondecreasing) on I if 
f(a) < fly) for all x, y EI witha <y. 

(b) f ts monotone decreasing (decreasing, nonincreasing) on I if 
f(x) > fly) for alla, y EI witha <y. 

(c) f is monotone on I if f is monotone increasing on I or monotone 
decreasing on I. 


A function f is strictly increasing on I if f(a) < f(y) for all z, y € I 
with x < y. The concept of strictly decreasing is defined similarly. Also, f is 
strictly monotone on J if f is strictly increasing on I or strictly decreasing 
on J. Our main result for monotone functions is as follows: 


THEOREM 4.4.7 Let I C R be an open interval and let f : I + R be 
monotone increasing on I. Then f(p+) and f(p—) exists for every p € I and 


sup f(z) = f(p—) < fp) < f(pt) = inf f(@). 


xr<p 
Furthermore, if p <q, p,q € I, then f(p+) < f(q-). 
Although we stated the theorem for monotone increasing functions, a sim- 


ilar statement is also valid for monotone decreasing functions. 


Proof. Fix p € I. Since f is increasing on I, {f(x) : a < p, « € I} is bounded 
above by f(p). Let 
A=sup{f(#):a<p,xe€ TI}. 


Then A < f(p). We now show that 
lim f(a) =A. 


xL—-p~ 
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The proof of this is similar to the proof of Theorem 3.3.2. Let ¢ > 0 be given. 
Since A is the least upper bound of {f(x) : x < p}, there exists x, < p such 
that 

A-—e< f(a) <A. 


Thus if, <a<p, A-—e< f(a) < f(x) < A. Therefore, 
|f(x)-Al<e forall t,a,<a<p. 
Thus by definition, lim f(x) = A. Similarly 
2p 
f(p) S fet) = inf{ f(x) :p <2, x € Th. 


Finally, suppose p < q. Then 


f(pt+) =inf{f(rz):c2>p,ceT} <inf{f(r):p<a<q} 
< sup{f(x): p< 2x <q} <sup{f(z):2<q¢,xeT}=f(q-). 


COROLLARY 4.4.8 If f is monotone on an open interval I, then the set 
of discontinuities of f is at most countable. 


Proof. Let E = {p € I: f is discontinuous at p}. Suppose f is monotone 
increasing on J. Then 


pekE if and only if f(p—) < ft). 
For each p € EF, choose rp € Q such that 
f(p-) < tp < f(p+). 


If p < q, then f(p+) < f(q—). Therefore, if p,q € E, rp # rq, and thus the 
function p + Tr, is a one-to-one map of F into Q. Therefore EF is equivalent 
to a subset of Q and thus is at most countable. 


Construction of Monotone Functions with Prescribed Dis- 
continuities 


We now proceed to show that given any finite or countable subset A of (a, b), 
there exists a monotone increasing function f on [a,b] that is discontinuous 
at each « € A and continuous on [a,b] \ A. We first illustrate how this is 
accomplished for the case where A = {aj,...,@,} is a finite subset of (a,b). To 
facilitate this construction we define the unit jump function J on R as follows: 


DEFINITION 4.4.9 The unit jump function J: R— R is defined by 


h 
Oe 0, when & <0, 
1, when x > 0. 
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The function J is right continuous at 0 with 7(0+) = (0) = 1 and [(0—) = 
0. For each k = 1,...,n, let 


0, whens <a, 


, when x > ag. 


FIGURE 4.11 
Graph of I(x — a) 


Then J; has a unit jump at each a, and is right continuous at a, (see Fig- 
ure 4.11). 


Suppose {c1,...,Cn} are positive real numbers. Define f on [a,b] by 
f(x) = S- Cel (x — ax). 
k=1 


The reader should verify that the function f is 

(a) monotone increasing on [a, bJ, 

(b) continuous on |a, b] \ {a1, a2, ..., an}, 

(c) right continuous at each a,x, k = 1,2,...,n, and 

(d) discontinuous at each ag with f(ag+) — f(ax—) = cx for all k = 
12s wey ds 
That such a function exists for any finite subset {aj,...,@,} of (a,b) is not 
surprising. However, that such a function exists for any countable subset A of 
(a, b) may take some convincing, especially if one takes A to be dense in [a, 0]; 
e.g., the rational numbers in (a, b). 
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THEOREM 4.4.10 Let a, b € R witha < b, and let {an}nen be a countable 
subset of (a,b). Let {cn $92, be any sequence of positive real numbers such that 


>> cn converges. Then there exists a monotone increasing function f on [a, | 
n=1 
such that 


(a) f(a) =0 and f(b) = S, Cn, 


(b) f is continuous on [a,b] \ {ap :n =1,2,... }, 
(c) f(an+) = f(an) for all n; i.e. f is right continuous at all xp, and 


(d) f ts discontinuous at each x, with 


f(@n) — f@n-) = en. 


Proof. For each x € [a, b], define 
f(x) = a Cnt (x — an). 
n=1 


Since 0 < c,I (a — &) < Cy for each x € [a,b], we have 


$n(X) = So cel (x —2£E) < Se < See 
k=1 k=1 k=1 
Thus for each « € [a,b], the sequence {s,(x)} of partial sums is monotone 
increasing and bounded above and hence by Theorem 3.7.6 converges. Since 
I(x — an) < I(y— an) T= 12.52% 


for all x, y with x < y, f is monotone increasing on [a, b]. Furthermore, since 
tn > a for all n, I(a— xp) = 0 for all n. Therefore f(a) = 0. Also, since 


I(b—2&,) = 1 for all n, 
f() = ee. 
k=1 


This proves (a). 

We now prove (b). Fix p € [a,b], p # Xp» for any n. Let EF = {a,:n € N}. 
There are two cases to consider. 

(i) Suppose p is not a limit point of E. If this is the case, there exists a 
5 > 0 such that N5(p) NE = 0. Then 


I(x —ax,) =I (p — £x) for all x € (p—d6,p+0) 


and all k = 1,2,.... Thus f is constant on (p—06,p+6) and hence continuous. 
(ii) Suppose p is a limit point of E. Let € > 0 be given. Since the series 
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co 

>> cp converges, by the Cauchy criterion there exists a positive integer N 
k=1 

such that 


lo) 
> Ch <€. 


k=N+1 
Choose 6 such that 


0<6<min{|p—2,|:n=1,2,...,N}. 


With this choice of 6, if x, € Ns(p)MNE, we have k > N. Suppose p < x < p+. 
Then 
I(p—2,~) =1(a— xz) for all k=1,2,...,.N. 


Furthermore, for any x > p, we always have 
O0<I(a@-—a,)-—I(p— 2p) <1, for all KEN. 


Therefore, for p<a<p+o, 


O<f(x)-f(p)< >> ce(I(e—an)-Ip—ae))< So a<e. 
k=N+1 k=N+1 


Thus f is right continuous at p. Similarly, f is left continuous at p, and 
therefore f is continuous at p. 


For the proof of (c), fix an v, € E. If x, is an isolated point of F, then 
as above, there exists a 6 > 0 such that EM (an,%, + 6) = O. Therefore 
f(y) = f(@n) for all y, 1 < y < & +6. Thus f(tn+) = f(r). Suppose rp, 
is a limit point of FE. Let e > 0 be given. Again, choose a positive integer N 


so that 
[oe) 
ys Ch <€. 
k=N+41 


As in (b), there exists a d > 0 such that if x, € (tp, %, +60)NE, thank > N. 
Thus 


0< f(y) — flan) < S- Ck <€ for all y € (an, Up +0). 
k=N41 


Therefore f(x,+) = f(a,) and f is right continuous at each x. 


For the proof of (d), suppose y < xy. Again, if x, is an isolated point of 
E, there exists a 6 > 0 such that (v7, —6,¢%,) NE = @. Therefore, for all k 4 n, 


I(y — 2p) =1(an — x) for all y, tn —0 <y <n, 
and for all y < @p, 


0=I(y— ap) < Tap, — %p) = 1(0) = 1. 
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Therefore, 
flan) — f(y) =cn for all y, tn —O< YY < apy. 
Suppose z,, is a limit point of E. Given « > 0, choose N such that > cy, < 
k=N41 


e. For this N, choose 6 > 0 such that if z, € (tn — 6,2n)N E then k > N. 
Then for all y € [a,b] with 2, —d <y < an, 


CO 
Cn S f(tn)— f(y) Sent SD ce<ente. 
k=N+1 


Therefore, f(a») — f(@n—) = Cn. 


EXAMPLES 4.4.11 (a) Take c, = 27", te, =1-—1/(n+1),n =1,2,..., 
(a,b) = (0,1). As in Theorem 4.4.10 let 


f(x) = S- Cnt (a — an). 
n=1 
In this example, the sequence {x,,} satisfies 0 < a1 < a <-:: < 1 If 
0O<a<x2= 3, then I(a — x,) = 0 for all n. Thus 
f(@z)=0, awe 0,5). 
Ifa, <xu< a2 = 2, then I(a — a1) = 1 and I(a — xx) = 0 for all k > 2. 
Therefore, 
L 
iO =a = x € [§, 5): 
If zo < @ < 23 = 3, then I(x — zg) = 1 for k = 1,2 and I(x — zy) = 0 for 
k > 3. Therefore, 


2° 2 AP 
and so forth. The graph of f is depicted in Figure 4.12. 


(b) Let c, = 2~” and let {2} be an enumeration of the rationals in (0, 1). 
Theorem 4.4.10 guarantees the existence of a nondecreasing function on [0, 1], 
which is discontinuous at each rational number in (0,1), and continuous at 
every irrational number in (0, 1). 


(c) If in the proof of Theorem 4.4.10 we take {a,}nen to be a countable 
subset of R and choose {cn }nen (Cn > 0) such that > cy, = 1, then we obtain 
n=1 
a nondecreasing real-valued function f on R satisfying lim f(x) = 0 and 
~—>—0o0 


lim f(a) = 1. (See Exercise 21) Such a function is called a distribution 
L—-Co 


function on R. Such functions arise naturally in probability theory. 
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FIGURE 4.12 
Graph of f(x) = > cpl (a — tn) 


Inverse Functions 


Suppose f is a strictly increasing real-valued function on an interval J. Let 
x,y€Iwithe ¢y. Ifa < y, then since f is strictly increasing, f(x) < f(y). 
Similarly, if « > y then f(a) > f(y). Thus f(a) 4 f(y) for any x, y € I with 
x # y. Therefore f is one-to-one and consequently has an inverse function f~+ 
defined on f(Z). In the following theorem we prove that if f is continuous on 
I then f~! is also continuous on f (J). 


THEOREM 4.4.12 Let IC R be an interval and let f : I + R be strictly 
monotone and continuous on I. Then f~* is strictly monotone and continuous 


on J = f(L). 


Proof. Without loss of generality we consider the case where f is strictly 
increasing on I. Since f is continuous, by Corollary 4.2.12 f(I) = J is an 
interval. Furthermore, since f is strictly increasing on J, f is a one-to-one 
function from I onto J. Hence f~+ is a one-to-one function from J onto I. 

Suppose yi, y2 € J with y; < y2. Then there exist distinct points 71, x2 € 
I such that f(2;) = yi, i = 1,2. Since f is strictly increasing, we have x1 < x2. 
Thus f~'(y1) < f~*(y2), ie., f~! is strictly increasing. 

It remains to be shown that f~! is continuous on J. We first show that 
f—? is left continuous at each y, € J for which (—00, yo) NJ # @. This last 
assumption only means that y, is not a left endpoint of J. Let x, € I be such 
that f(%o) = Yo. Then (—oo,2,) NI # @. Let € > 0 be given. Without loss of 
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Yo =f %o) 
y 
Yo O 


FIGURE 4.13 
Continuity of the inverse function 


generality, we can assume that € is sufficiently small so that x, — € € I. Since 
f is continuous and strictly increasing, 


Ff ((@o — € tol) = (Flo — ©), F(%o)] = (Yo — 4, Yo] 


where 6 > 0 is given by 6 = f(x.) — f(xo — €). Thus since f~? is strictly 
increasing, 


®o —€= f(y — 8) < F-"(y) < F-" (Yo) = 2o 


for all y € (yo — 6, Yo) (see Figure 4.13). Hence, 


IF"(Yo) — f(y) <€ for all y € (Yo — 5, Yo]. 


Therefore f~! is left continuous at y,. A similar argument also proves that 
f—' is right continuous at each y, € J that is not a right endpoint of J. Thus 
f—' is continuous at each yo € J. 


For a strictly increasing function f on an open interval J, an alternate 
proof of the continuity of the inverse function f—! is suggested in the exercises 
(Exercise 14). 


EXAMPLE 4.4.13 The function f(x) = x? is continuous and strictly in- 
creasing on I = [0,00) with J = f(Z) = [0,co). Thus the inverse func- 
tion f~'(y) = \/y is continuous on [0,00). As a consequence, the function 
g(x) = V/Z is continuous on (0,00). Applying the same argument to f(x) = x” 
shows that the function g(x) = 7/z is strictly increasing and continuous on 
[0, 00). 
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Remark. In the statement of Theorem 4.4.12 we assumed that f was strictly 
monotone and continuous on the interval J. The fact that f is either strictly 
increasing or strictly decreasing on J implies that f is one-to-one on the in- 
terval I. Conversely, if f is one-to-one and continuous on an interval J, then 
as a consequence of the intermediate value theorem the function f is strictly 
monotone on I (Exercise 15). This, however, is false if either f is not contin- 
uous on the interval J, or if Dom f is not an interval. (See Exercises 16, 17, 
and 18). 


Exercises 4.4 


1. Prove Theorem 4.4.3. 
2. For each of the following functions f defined on R \ {0}, find lim f(x) 
x20 


and lim, f(x), provided the limits exist. 


x2—0 
z[t], «<0, 
a. aa *b. f(x) = [z] eee 
c. f(a) = [1-27] *d. fr) = [2 1 
e. f(x) = [+]: *f. f(x) =a +]: 


3. For each of the functions f in Exercise 2, determine whether f has a 
removable discontinuity, a jump discontinuity, or a discontinuity of second 
kind, at « = 0. If f has a removable discontinuity at 0, specify how f(0) 
should be defined in order that f is continuous at 0. 


4. *Investigate continuity of g(x) = (a — 2)[z] at xo = 2. 
5. Let f(a) =a — [a]. Discuss continuity of f. Sketch the graph of f. 


For each of the following determine the value of b such that f has a 
removable discontinuity at the indicated point x5. 


—2 i! 
0 10)= {5 , vas Lo=1 


ba? + 4, cL, 
—x* [a], x< 2, 
~ rey= {a pete. PER 


7. a. Sketch the graph of g(x) = sin(27a|[x]) for x € (—4,4). 
*b. Prove that g(x) is not uniformly continuous on R. 
Prove that the function f of Example 4.4.11(a) is continuous at x = 1. 


Let E CR and let f be a real-valued function on E. Suppose p € R is a 
limit point of E'M (p,oo). Prove that 


lim f(«#)=L ifandonlyif lim f(pn)=L 
a2—pt n—+0o 


for every sequence {py} in E with p, > p for alln € N and p, > p. 
10. Let f be a real-valued function (a, b]. 
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11. 


12. 
13. 


14. 


15. 


16. 


17. 
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*a. If f is continuous on (a,b] and lim, (x) exists, prove that f is 
ra 
uniformly continuous on (a, b]. 


b. If f is uniformly continuous on (a, b], prove that lim, f(x) exists. 
La 


Let f : [0,2] > R be defined by 
LT; O0<a< 1, 
f(x) = 2 
142°, 1l<a<2. 
Show that f and f~' are strictly increasing and find f((0,2]). Are f and 
f~' continuous at every point of their respective domains 
*Ifm € Z,n EN, prove that f(x) = 2”/” is continuous on (0,00). 


a. If f and g are monotone increasing functions on an interval J, prove 
that f +g is monotone increasing on J. 


b. If in addition f and g are positive, prove that fg is monotone increasing 
on I. 


c. Show by example that the conclusion in part (b) may be false if f and 
g are not both positive on I. 


Let J C R be an open interval and let f : J > R be strictly increasing 
and continuous on J. 


*a. If U C I is open, prove that f(U) is open. 
b. Use (a) and Theorem 4.2.6 to prove that f~' is continuous on f(J). 


Let J C R be an interval and let f be a one-to-one continuous real-valued 
function on J. Prove that f is strictly monotone on I. 


Let f : [0,1] > R be defined by 
22 <a<} 
ftom | eee 
a. Sketch the graph of f. 
*b. Show that f is one-to-one on [0,1], but not strictly increasing on 
(0, 1). 
*c. Show that f([0, 1]) = [0, 2]. 
*d. Find f7'(y). y € [0,2], and show that f~' is not continuous at 
Yo=l. 
Let E = [0,1] U [2,3), and for a € E set 
x, O0<a«<1l, 
em {7 2<2<3. 
a. Sketch the graph of f. 
b. Show that f is one-to-one and continuous on E. 
c. Show that f(£) = (0, 2]. 
d. Find f~'(y) for y € [0,2], and show that f~' is not continuous at 
Yo=l. 
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18. Let f : [0,1] > R be defined by 


_ x, rEeQ, 
w= 1%, rEQ. 


Prove that f is one-to-one, that f({0,1]) = [0,1], but that f is not mono- 
tone of any interval I Cc [0, 1]. 


19. Prove that if f is monotone increasing on [a,oo), a € R, and bounded 
above, then lim f(z) exists. 
«roo 


20. Let JC R be an interval and let f : J + R be monotone increasing. For 
p € Int(Z), the jump of f at p, denoted J;(p) is defined by 


Js (p) = fet) — f(p-). 

If p is a left endpoint, set Jr(p) = f(p+) — f(p), and if p is a right 
endpoint, set Js(p) = f(p) — f(p—). 

a. Prove that f is continuous at p € I if and only if Jr(p) = 0. 

b. If p € Int(Z), prove that Jr(p) = inf{f(y)—f(@):a<p<y,2,y € I}. 


21. Let {an}R21 be a countable subset of R and {cn }721 a sequence of posi- 
tive real numbers satisfying }> cp, = 1. Let f : R— R be defined by 


co 


f(x) = XS enI (x — an). 


n=1 


Prove that lim f(x) =O and lim f(x) =1. 
xL—>— Co LOO 


Notes 


The limit of a function at a point is one of the fundamental tools of analysis. Not 
only is it crucial to continuity, but also to many subsequent topics in the text. The 
limit process will occur over and over again. We will encounter it in the next chapter 
in the definition of the derivative. It will occur again in the chapters on integration, 
series, etc. 

Another very important concept that will be encountered on many other oc- 
casions in the text is uniform continuity. Uniform continuity is important in that 
given € > 0, it guarantees the existence of a 6 > 0 such that | f(x) — f(y)| < € for all 
x,y € Domf with |x — y| < 6. In Chapter 6 we will use this to prove that every 
continuous real-valued function on [a,b], a,b € R, is Riemann integrable on {a, bj. 
Other applications of uniform continuity will occur in many other theorems and in 
the exercises. 

One of the most important results of this chapter is the intermediate value 
theorem (Theorem 4.2.11). The intermediate value theorem has already been used 
in Corollary 4.2.13 to prove the existence of nth roots; namely, for every positive real 
number x and n € N, there exists a unique positive real number y such that y” = a. 
Even though the existence of nth roots can be proved without the intermediate 
value theorem, any such proof however is simply the statement that the function 
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f(x) = x” satisfies the intermediate value property on [0,a] for every a > 0. Other 
applications of the intermediate value theorem will occur elsewhere in the text. 

The proof of the intermediate value theorem depended on the fact that the 
connected subsets of R are the intervals (Theorem 2.2.25) and that the continuous 
image of a connected set is connected (Exercise 28 of Section 4.2). Assuming these 
two results, the intermediate value theorem is an immediate consequence as follows: 
Suppose f is continuous on [a,b]. Let J = f([a,b]). Then I is connected and thus 
must be an interval. Thus if f(a) < 7 < f(b), y € I and hence there exists c € [a, ] 
such that f(c) = y. That the continuous image of a connected set is connected 
follows from the definition. However, the proof that the connected subsets of R are 
the intervals requires the least upper bound property. 


Miscellaneous Exercises 


1. Let f be a continuous real-valued function on [a, b] with f(a) <0 < f(b). 
Let cr = $(a +b). If f(ci) > 0, let co = $(a+c1). If f(c1) < 0, let 
@Q= $(c1 + 6). Continue this process inductively to obtain a sequence 
{cn} in (a,b) which converges to a point c € (a,b) for which f(c) = 0. 


2. Let E& CR, p a limit point of E, and f a real-valued function defined on 
E. The limit superior of f at p, denoted lim f(z), is defined by 
Lp 


lim f(z) = inf sup{ f(a) : x € (No(p) \ {p}) 9 E}. 


Similarly, the limit inferior of f at p, denoted lim f(x), is defined by 


xp 


lim f(x) = sup me) :@ € (No(p) \ {p}) 0 E}. 


2p 

Prove each of the following: 

a. iim f(a) < L if and only if given € > 0, there exists a 6 > 0 such that 
f(x) e [+e for alla € FE, 0 < d(a,p) <6. 

b. iim f(x) > L if and only if given e > 0 and 6 > 0, there exists « € E 
with 0< d(x,p) <6 such that f(%) > L—e. 

ce. If lim f(x) = L, then for any sequence {z,} in E with x, # p: for all 
n EN, lim f(z,) < L. 

d. There exists a sequence {z,} in FE with x, 4 p for all n € N, such 


that 
lim f(an) = lim f(z). 
@2— Co @2—-p 


3. Let X C Rand f a real-valued function on X. For p € X, the oscillation 
of f at p, denoted w(f;p), is defined as 


w(f;p) = infsso sup{| f(x) — f(y)|: 2, y © Ns(p) A X}. 


Prove each of the following: 
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a. The function f is continuous at p if and only if w(f;p) = 0. 
b. For every s € R, the set {a € X : w(f;x) < s} is open. 
c. The set {x € X : f is continuous at x} is the intersection of at most 


countably many sets that are open in X. 


The following set of exercises involve the Cantor ternary function. Let 
P denote the Cantor ternary set of Section 2.3. For each x € (0, 1], let 
Z = .a1a2a3.... denote the ternary expansion of x. Define N as follows: 
ifa, #1 for alln EN, 


otherwise. 


N= ie 
min{n : dn = 1}, 
Define 6, = $an for n < N, and by = 1, if N is finite. (Note: b, € {0,1} 
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for all n.) 


N 
4. Ifx € (0, 1] has two ternary expansions, show that }> 


of the expansion of x. 


b 

— is independent 
4 9n 

n=1 


The Cantor ternary function f on [0,1] is defined as follows: f(0) = 0, 
and if x € (0,1] with ternary expansion x = .a1a@2a@3...., set 


N bp 


Sn? 
n=1 an 


flz)= 


where N and by are defined as above. 


5. Prove each of the following: 


a. f is monotone increasing on [0, 1]. 


b. f is constant on each interval in the complement of the Cantor set in 


(0, 1]. 
c. f is continuous on (0, 1]. 
d. f(P) = [0,1]. 


e. Sketch the graph of f. 
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Differentiation 


The development of differential and integral calculus by Isaac Newton (1642- 
1727) and Gottfried Wilhelm Leibniz (1646-1716) in the mid seventeenth cen- 
tury constitutes one of the great advances in mathematics. In the two years 
following his degree from Cambridge in 1664, Newton invented the method 
of fluxions (derivatives) and fluents (integrals) to solve problems in physics 
involving velocity and motion. During the same period he also discovered the 
laws of universal gravitation and made significant contributions to the study 
of optics. Leibniz on the other hand, whose contributions came 10 years later, 
was led to the invention of calculus through the study of tangents to curves 
and the problem of area. The first published account of Newton’s calculus 
appeared in his 1687 treatise Philosophia Naturalis Principia Mathematica. 
Unfortunately however, much of Newton’s work on calculus did not appear 
until 1737, ten years after his death, in a work entitled Methodus fluxionum 
et serierum infinitorum. 

Mathematicians prior to the time of Newton and Leibniz knew how to 
compute tangents to specific curves and velocities in particular situations. 
They also knew how to compute areas under elementary curves. What dis- 
tinguished the work of Newton and Leibniz from that of their predecessors 
was that they realized that the problems of finding the tangent to a curve 
and the area under a curve were inversely related. More importantly however, 
they also developed the notation and a set of techniques (a calculus) to solve 
these problems for arbitrary functions, whether algebraic or transcendental. 
In Newton’s presentation of his infinitesimal calculus he looked upon y as a 
flowing quantity, or fluent, of which the quantity y was the fluxion or rate 
of change. The notation of Newton is still in use in physics and differential 
geometry, whereas every student of calculus is exposed to the d (for difference) 
and f{ (for sum) notation of Leibniz to denote differentiation and integration. 
Many of the basic rules and formulas of the differential calculus were devel- 
oped by these two remarkable mathematicians. In the paper A New Method 
for Maxima and Minima, and also for Tangents, which is not Obstructed by 
Irrational Quantities published in 1684, Leibniz gave correct rules for differ- 
entiation of sums, products, quotients, powers, and roots. In addition to his 
many contributions to the subject, Leibniz also disseminated his results in 
publications and correspondence with colleagues throughout Europe. 

Newton and Leibniz with their invention of the calculus had created a tool 
of such novel subtlety that its utility was proved for over 150 years before 
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its limitations forced mathematicians to clarify its foundations. The rigorous 
formulation of the derivative did not occur until 1821 when Cauchy provided a 
formal definition of limit. This helped to place the theory on a firm mathemat- 
ical footing. Cauchy’s contributions to the rigorous development of calculus 
will be evident both in this and subsequent chapters. 

In this chapter, we develop the theory of differentiation based on the defi- 
nition of Cauchy, with special emphasis on the mean value theorem and con- 
sequences thereof. The first section presents the standard results concerning 
derivatives of functions obtained by means of algebraic operations and com- 
position. In the examples and exercises we will derive the derivatives of some 
of the basic algebraic and trigonometric functions. However, throughout the 
chapter we will assume that the reader is already familiar with standard tech- 
niques of differentiation and some of its applications. As a consequence we 
will concentrate on the mathematical concepts of the derivative, emphasizing 
many of its more subtle properties. 


5.1 The Derivative 


In an elementary calculus course the derivative is usually introduced by con- 
sidering the problem of the tangent line to a curve or as the problem of finding 
the velocity of an object moving in a straight line. Suppose y = f(a) is a real- 
valued function defined on an interval [a,b]. Fix p € [a, b]. For x € [a,b], « # p, 
the quantity 


t—?p 
represents the slope of the straight line (secant line) joining the points 
(p, f(p)) and (a, f(x)) on the graph of f (see Figure 5.1). The function Q(x) 
is defined for all values of x € [a,b], c 4 p. The limit of Q(x) as x approaches 
p, provided this limit exists, is defined as the slope of the tangent line to the 
curve y = f(x) at the point (p, f(p)). 

A similar type of limit occurs if we consider the problem of defining the 
velocity of a moving object. Suppose that an object is moving in a straight 
line and that its distance s from a fixed point P is given as a function of ¢; 
namely s = s(t). If t, is fixed, then the average velocity over the time interval 
from t to ty, t # to, is defined as 


s(t) = s(to) 


t —to 


The limit of this quantity as t approaches t,, again provided that the limit 
exists, is taken as the definition of the velocity of the object at time to. 
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FIGURE 5.1 
Secant line between two points on the graph of f 


Both of the previous two examples involve identical limits; namely, 


a t)—s(t 
jim LO-LO) ong ann = Sto) 
zp xL-—D toto t—to 
These limits, if they exist, are called the derivatives of the functions f and s 
at p and t, respectively. The term derivative comes from the French fonction 
derivée. 


DEFINITION 5.1.1 Let I Cc R be an interval and let f be a real-valued 
function with domain I. For fixed p € I, the derivative of f at p, denoted 
f'(p), ts defined to be 


zp r—p 
provided the limit exists. If f’(p) is defined at a point p € I, we say that f 
is differentiable at p. If the derivative f’ is defined at every point of a set 
E CI, we say that f is differentiable on E. 


If p is an interior point of J, then p+h € I for all A sufficiently small. If 
we set x = p+h, h £0, then the definition of the derivative of f at p can be 


expressed as Ke b)— fe) 
! : prh)—J(p 
f'(p) = im ——{——, 
provided that the limit exists. This formulation of the derivative is sometimes 
easier to use. 
In the definition of the derivative we do not exclude the possibility that p 
is an endpoint of J. If p € I is the left endpoint of J, then 


fi) it, 2D) ang TE 


apt x—p hot : 
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provided of course that the limit exists. The analogous formula also holds if 
p € I is the right endpoint of J. In analogy with the right and left limit of a 
function we also define the right and left derivative of a function. 


DEFINITION 5.1.2 Let IC R be an interval and let f be a real-valued 
function with domain I. If p € I is such that IN (p,oo) # Q, then the right 
derivative of f at p, denoted f', (p), is defined as 


Pee tee POPE) = FO) 
Ftp) = lin, PANE 


> 


provided the limit exists. Similarly, if p € I satisfies (—oo, p) NI #0, then the 
left derivative of f at p, denoted f' (p), is given by 


ph aes. LER) FD) 
f(p) = lim ——[———, 


provided the limit exists. 


Remarks. (a) If p € Int(/), then f’(p) exists if and only if both f{ (p) and 
f'(p) exist, and are equal. On the other hand, if p € I is the left (right) 
endpoint of J, then f’(p) exists if and only if f{(p) (fi (p)) exists. In this 
case, f’(p) = f.(p) (f“(p)). 

The reader should note the distinction between f/(p) and f’(p+). The 
first denotes the right derivative of f at p, whereas the later is the right limit 
of the derivative; i.e., 

f' (p+) = lim, f'(2). 
apt 


Here of course we are assuming that f’ is defined for all x € (p,p+6) for some 
CD: 

(b) If f is a differentiable function on an interval J, we will also occasionally 
use Leibniz’s notation 


to denote the derivative of y = f(z). 

(c) If f is differentiable on an interval J, then the derivative f’() is itself 
a function on J. Therefore we can consider the existence of the derivative of 
the function f’ at a point p € I. If the function f’ has a derivative at a point 
p € I, we refer to this quantity as the second derivative of f at p, that we 
denote f”(p). Thus 


" yk 
f (p) = jim 


f'(p +h) — f'(p) 

h . 
In a similar fashion we can define the third derivative of f at p, denoted f’” (p) 
or f)(p). In general, for n € N, f(™(p) denotes the nth derivative of f at 
p. In order to discuss the existence of the nth derivative of f at p, we require 


the existence of the (n — 1) st derivative of f on an interval containing p. 
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EXAMPLES 5.1.3 (a) In the exercises (Exercise 2) you will we asked to 
prove that if f(z) = 2", n € Z, then f’(z) =na"“! for allz ER (z# 40 ifn 
is negative). For the function f(a) = x7, the result is obtained as follows: 


h 2 m2 
Cia eek ee ey et es 
h h-0 


A similar computation shows that f(x) = 2. 
(b) Consider f(x) = /z, « > 0. We first note that for h 4 0. 


fe +h) = fe) _ vert = Va 


h 
en &) (Vx +h+ Va) 
h (Vath+ Vx 
1 
Ve tht Ve 


Since lim Vi+th=\/z. we have 


1 1 
m => e 
h0/et+h+ fe 22/f/a 


(c) Consider f(x) = sin. From the identity 


f(a) = 


sin(a +h) = sinxcosh + cosa sinh 


we obtain 


sin(g+h)—sing cosh — 1 n sinh 
A naz |—>—| + cosx ]——] . 


By Example 4.1.10(d) and Exercise 5, Section 4.1, 


i h-1 
i st ae ee 
hoo A h-0 h 
Therefore, 
ry ye. Sin(a +h) —sing 
ae ee 
: : cosh — 1 . sinh 
= sing lim | ————] + cosa lim 
h-0 h hoo| h 
= cosa. 
: : d : 
In Exercise 3 you will be asked to prove that —(cosx) = — sina. 


dx 
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(d) Let f be defined by 


©; x > 0, 
ney=wl={ 2 er 
Then 
Ripe = Hpins Wllre ae os. A 
LS ee ae ane 
“(0 isp lt aia puna, 
f° (0) 


hnoo- h hnoo- Ah 
Thus f{.(0) and f/ (0) both exist, but are unequal. Therefore f’(0) does not 
exist. 
(e) In this example, let g(a) = x°/? with Dom g = [0, 00). Then for p = 0, 


3/2 
g' (0) = g.(0) = lim — = lim Vx=0. 


z>0+ 2X 20+ 


Thus g is differentiable at 0 with g’(0) = 0. 
(f) Let f be defined by 


1 
xsin—-, «40, 
x 
0, xr=0. 


f(x) = 


1 1 1 
For x £0, f’(x) = cos — + sin — (Exercise 8). When « = 0, 
x av av 


et) oat AC ere 
i = = _ 
F(0) ea h BE Ey 
which by Example 4.1.5(a) does not exist. Therefore f’(0) does not exist. 


(g) Consider the following variation of (f). Let 


. 1 
x?sin—-, «#0, 
x 


g(x) = 
0, x=0. 

This example is very important! In Exercise 9 you will be asked to show that 
g'(x) exists for all « € R with g’(0) = 0, but that the derivative g’ is not 
continuous at 0. 


When Cauchy gave the rigorous definition of the derivative, he assumed 
that the given function was continuous on its domain. As a consequence of 
the following theorem this requirement is not necessary. 
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THEOREM 5.1.4 Jf I CR ts an interval and f : I > R is differentiable at 
pe€T, then f is continuous at p. 


Proof. For t 4 p, 


Since 
lim 
tp t—p 
exists and equals f’(p), by Theorem 4.1.6(b), 


ft) 


; lim(t — p) = f’(p)-0=0. 
—p 


tp 


Him f(8) ~ Flo) = Fim ( 


tp tp 


Therefore, lim f(t) = f(p) and thus f is continuous at p. In the above, if p is 
Pp 


an endpoint, then the limits are either the right or left limit at p, whichever 
is appropriate. 


Remark. In both Examples 5.1.3(d) and (f), the given function is continuous 
at 0, but not differentiable at 0. Given a finite number of points, say p1,..., Dn, 
it is easy to construct a function f that is continuous but not differentiable 
at p1,.--,Pn- For example, 


f(z) =o le — pel 
k=1 


has the desired properties. In 1861, Weierstrass constructed a function f that 
is continuous at every point of R but nowhere differentiable. When published 
in 1874, this example astounded the mathematical community. Prior to this 
time mathematicians generally believed that continuous functions were differ- 
entiable (except perhaps at a finite number of points). In Example 8.5.3 we 
will consider the function of Weierstrass in detail. 


Derivatives of Sums, Products, and Quotients 


We now derive the formulas for the derivative of sums, products, and quotients 
of functions. These rules were discovered by Leibniz in 1675. 


THEOREM 5.1.5 Suppose f,g are real-valued functions defined on an in- 
terval I. If f and g are differentiable at x € I, then f +g, fg and f/g (if 
g(x) #0) are differentiable at x and 
(a) (f+g)(2) = f(x) +9'(2), 
(b) (f9)'(2) = f'(@)g(@) + fle)g'(2) 
/ 


(c) (4) (2) = P(#)g(#) — fla)o"(z) provided g(a) #0. 
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Proof. The proof of (a) is left as an exercise (Exercise 4). For the proof of 
(b), by adding and subtracting the term f(x + h)g(x), we have for h 4 0, 


ole N= VANE) _ pop 4m) (Mer 00) 


h = 
- (SEAM LO) atu, 


By Theorem 5.1.4, since f is differentiable at x, jim f(a +h) = f(x). Thus 
aay 


since each of the limits exist, by Theorem 4.1.6 


—soan (le +h) = (F(x) 


(F9)'(2) = Jim ! 
= lim f(x +h) lim (setae) 
+ 9(2) lim (Meee Be 
= f(x)g'(x) + g(a) f"(2). 
To prove (c), we first prove that (1/g)'(«) = —g'(x)/[g(x)]*, provided 


g(x) #0. The result then follows by writing f/g as f-(1/g) and applying the 
product formula (b). If g(x) 4 0, then since g is continuous at x, as in Theorem 
4.1.6(c), g(a +h) £0 for all h sufficiently small. Thus for h sufficiently small 
and nonzero, 


1 1 


gath) g(x) _ (se +h 90) 1 
h h g(a) g(x +h)’ 


Again, using the fact that jim g(a +h) = g(x), by Theorem 4.1.6 
= 


1 1 
iy” _ gla+h) g(x) 
Cle aa 
_ 4. (glw@+h)— ge) 1 
lan ( h ee oreeey 
_ ~9 (2) 
g(x) 


The Chain Rule 


The previous theorem allows us to compute the derivatives of sums, products, 
and quotients of differentiable functions. The chain rule on the other hand 
allows us to compute the derivative of a function obtained from the composi- 
tion of two or more differentiable functions. Prior to stating and proving the 
result, we introduce some useful notation. 
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Suppose f is differentiable at « € J. Fort € I, t # x, set 
f(t) — f(z) 


t—2 


Q(t) = 


Then by Definition 5.1.1, Q(t) > f’(a) ast > a. If we let u(t) = Q(t) — f’(x), 
then u(t) > 0 as t > a. Therefore, if f is differentiable at x, for t 4 az, 


f() — f(x) =(t-2) [f'(x) + u(t)], where u(t) ~Oasto-a. (1) 
By setting u(x) = 0, the above identity is valid for all t € I. 


THEOREM 5.1.6 (Chain Rule) Suppose f is a real-valued function de- 
fined on an interval I and g is a real-valued function defined on some interval 
J such that Range f C J. If f is differentiable at x € I and g is differentiable 
at f(x), thnh=gof is differentiable at x and 


Proof. Let y = f(x). Then by (1) 
f(t)— f(x) =(¢- 2) [f'(z) + ud), (2) 
9(s) — g(y) = (s—y) Ig'(y) + v(s)], (3) 


wheret € J, s € J and u(t) — Oast > x and v(s) > Oass > y. Let s = f(t). 
Since f is continuous at x, s > y as t > a. By identity (3), and then (2), 


Therefore, for t 4 x, 
A(t) — h(a) 


t-—2£ 


= [f"(@) + u)] Loy) + oF O)I- 


Since u(f(t)) and u(t) both have limit 0 as t > a, 


AES = f(0) 9! y) = 9 (F(@)) F(2). 


To illustrate the previous theorem we consider the following examples. 


EXAMPLES 5.1.7 (a) By Example 5.1.3(c) the function f(x) = sina is 
differentiable on R. Hence if g : I > R is differentiable on the interval J, 
h(a) = (fo g)(x) = sin g(x) is differentiable on J with 


hi(a) = f'(g(a))g"(x) = g(a) cos g(a). 
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In particular, if g(x) = 1/x?, Domg = (0,00), then by Theorem 5.1.5(c), 


—22 2 
! = _ 
g (x) = (x2)? = 3? TE (0, 00). 
Therefore, 
d 1 2 1 
sin = cos —. 
dx x? x? xv? 


(b) By Exercise 2 
d 


a 
Thus if f : J > R is differentiable on the interval J, then by the chain rule 
g(x) = [f(x)|", n €N, is differentiable on I with g'(x) = n[f(x)|"~'f'(z). 
This formula can also be obtained from Theorem 5.1.5(b) using mathematical 
induction. 


"—ne"! for alln EN. 


Exercises 5.1 


1. Use the definition to find the derivative of each of the following functions. 


*a, f(x) = 2°, «ER b. g(z) =Vr+2, a> -2 
1 1 
Fe. Ale). a4 0 d. k(x) = , “£>-2 
()=1, of @)= Tas 
x x 
ae Rc ba err x#—l oC aaa ara ceR 
2. *Prove that for all integers n, £ z” =na"—' (2 £0 if n is negative). 
3. *a. Prove that Bees x) = —sinz. 
dx 
b. Find the derivative of tana = ——~. 
cos & 


4. Prove Theorem 5.1.5(a). 


For each of the following, determine whether the given function is differ- 
entiable at the indicated point xo. Justify your answer! 


*a. f(z) =a2l|z| at x =0 


2 
fe : oe at ro = 0 
p] x ’ 
*c. g(x) = (x — 2)[z], at ro = 2 
d. h(x) = Vx +2, x € [-2,00), at xo = —2 
vation fire 68 


4/3 0 
rote) =|" cos z, Eee at to =0 


at %o = 0 
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6. Let f(x) = |az|?. Compute f’(z), f(x), and show that f’”(0) does not 


exist. 


7. Determine where each of the following functions from R to R is differen- 
tiable and find the derivative. 
*a. f(x) = 2 [a]. b. g(x) = |a — 2| + |x +1]. 
1 
2 
—|, O<a@r<l, 
*c. h(x) = |sina]. d. k(x) = ‘ B ne 
0, x=0 
8. Use the product rule, quotient rule, and chain rule to find the derivative 
of each of the following. 
a f(z) =asin+, «#0 b. f(x) = (cos(sinz)")™ , n,m EN 
ce Vrt+V24+2 d. f(z) =a*(e+sin+), «40 
a) 
sin* % 
©. f(#) = 1+sin? x 
9. Let g be defined by 


od 
asin — xz #0, 


0, x=0. 


g(x) = 


a. Prove that g is differentiable at 0 and that g’(0) = 0. 
*b. Show that g(x) is not continuous at 0. 
10. Let f be defined by 
x? +2, x< 2, 
ey {o> a> 2. 
*a. For what values of a and 6 is f continuous at 2 ? 
*b. For what values of a and 6 is f differentiable at 2? 
11. Let f be defined by 
ax +b, Ex 1, 
f@)=4e°+1, -lsas2, 
cx + d, x> 2. 


Determine the constants a,b,c, and d such that f is differentiable on R. 


12. Assume there exists a function L : (0,00) > R satisfying L’(x) = 1/zx for 
all x € (0,00). Find the derivative of each of the following. 
*a. f(x) = L(2x+1), 2% >-% b. g(x) = L(x”), « £0 
*e. h(x) =[L(a)]’, « > 0 
d. k(x) = L(L(x)), x € {x > 0: L(x) > O} 
13. Let L be the function of Exercise 12. 
a. Show that L is one-to-one on (0,00). 
b. Let E = L~' on R. By considering L(E(y)) prove that E’(y) = E(y). 
14. For 6 real, let f be defined by 


nau 
x? sin —, x> 0, 
x 


0, x<0. 


f(x) = 
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Prove the following: 
a. f is continuous at 0 if and only if b > 0. 
*b. f is differentiable at 0 if and only if b > 1. 
c. f’ is continuous at 0 if and only if b > 2. 
15. a. If f is differentiable at x, prove that 


wy f(to th) = f@o =) _ 
a 2h P(e). 


Heat i ee ee 
h—0 2h 
16. If f: (a,b) > R is differentiable at p € (a,b), prove that 
f'(p) = lim nif(p+ a) — f@)I- 
Show by example that the existence of the limit of the sequence 
{n[f(p + +) — f(p)]} does not imply the existence of f’(p). 
17. (Leibniz’s Rule) Suppose f and g have nth order derivatives on (a, b). 


exists, is f differentiable at x? 


Prove that 
(fa) e) => (") £ (a)g"— (a), 


5.2 The Mean Value Theorem 


In this section, we will prove the mean value theorem and give several conse- 
quences of this important result. Even though the proof itself is elementary, 
the theorem is one of the most useful results of analysis. Its importance is 
based on the fact that it allows us to relate the values of a function to values 
of its derivative. We begin the section with a discussion of local maxima and 
minima. 


Local Maxima and Minima 


DEFINITION 5.2.1 Suppose E C R and f is a real-valued function with 
domain E. The function f has a local maximum at a point p € E if there 
exists ad > 0 such that f(x) < f(p) for alla € EN N5(p). The function f 
has an absolute maximum at p € E if f(x) < f(p) for alla ec E. 


Similarly, f has a local minimum at a point q € E if there exists a 
5 > 0 such that f(x) > f(q) for alla € EN N5(q), and f has an absolute 
minimum at q€ E if f(x) > f(q) for alla € E. 


Remark. As a consequence of Corollary 4.2.9, every continuous real-valued 
function defined on a compact subset K of R has an absolute maximum and 
minimum on Kk. 
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(a, F(P4)) 


1-FPy) 


FIGURE 5.2 
Absolute maxima and minima on the graph of f 


The function f illustrated in Figure 5.2 has a local maximum at a, p2, and 
pa, and a local minimum at p;,p3, and b. The points (pa, f(pa)) and (p1, f(p1)) 
are absolute maxima and absolute minima respectively. 

The following theorem gives the relationship between local maxima of a 
function defined on an interval and the values of its derivative. 


THEOREM 5.2.2 Let f be a real-valued function defined on an interval I, 
and suppose f has either a local minimum or local maximum at p € Int(I). If 
f is differentiable at p, then f’(p) = 0. 


Proof. If f is differentiable at p € Int(J), then f!(p) and f{(p) both exist 
and are equal. Suppose f has a local maximum at p. Then there exists a 
6 > 0 such that f(t) < f(p) for all t € I with |t — p| < 6. In particular, if 
p<t<p+t+o,teéT, then 


fO-f®) - 4 
t-p ~ 
Thus f/(p) < 0. Similarly, ifp—d <t<p, 
f)-f) . 4 
t-p ~? 


and therefore f’(p) > 0. Finally, since fi (p) = fi(p) = f’(p), we have 
f'(p) = 0. The proof of the case where f has a local minimum at p is similar. 


As a consequence of the previous theorem we have the following corollary. 
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COROLLARY 5.2.3 Let f be a continuous real-valued function on |a, b]. If 
f has a relative mazimum or minimum at p € (a,b), then either the derivative 
of f at p does not exist, or f'(p) = 0. 


Remark. The conclusion of Theorem 5.2.2 is not valid if p € J is an endpoint 
of the interval. For example, if f : [a,b] + R has a relative maximum at a, and 
if f is differentiable at a, then we can only conclude that f’(a) = f' (a) < 0. 
This is illustrated in the following 


EXAMPLES 5.2.4 (a) The function 


2 
see) = (2-5) . 0<2<2, 


IR 


has a local maximum at p = 0 and p = 2, and an absolute minimum at gq = 
By computation, we have (0) = —1, f/ (2) =3, and f’($) =0. In Exerci 
1 you will be asked to graph the function f. 


e 


Dw 


(b) The function f(x) = |x|, « € [—1,1], has an absolute minimum at 
p = 0. However, by Example 5.1.3(d) the derivative does not exist at p = 0. 


Rolle’s theorem 


Prior to stating and proving the mean value theorem we first state and prove 
the following theorem due to Michel Rolle (1652-1719). 


THEOREM 5.2.5 (Rolle’s Theorem) Suppose f is a continuous real- 
valued function on [a,b] with f(a) = f(b), and that f is differentiable on 
(a,b). Then there exists c € (a,b) such that f’(c) =0. 


Since the derivative of f at c gives the slope of the tangent line at (c, f(c)), a 
geometric interpretation of Rolle’s theorem is that if f satisfies the hypothesis 
of the theorem, then there exists a least one value of c € (a,b) where the 
tangent line to the graph of f is horizontal. For the function f depicted in 
Figure 5.3, there are exactly two such points. 

Proof. If f is constant on [a,b], then f’(a) = 0 for all x € [a,b]. Thus, we 
assume that f is not constant. Since the closed interval [a,b] is compact, by 
Corollary 4.2.9, f has a maximum and a minimum on |a, }]. If f(t) > f(a) for 
some t, then f has a maximum at some c € (a,b). Thus by Theorem 5.2.2, 
f’(c) = 0. If f(t) < f(a) for some t, then f has a minimum at some c € (a,b), 
and thus again f’(c) = 0. 
Remarks. (a) Continuity of f on [a,6] is required in the proof of Rolle’s 


theorem. The function 
L, 0<a<il, 
r= {* aad 
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f@ = 


FIGURE 5.3 
Rolle’s theorem 


is differentiable on (0,1) and satisfies f(0) = f(1) = 0; yet f’(x) 4 0 for all 
x € (0,1). The function f fails to be continuous at 1. 


(b) For Rolle’s theorem, differentiability of f at a and 6 is not required. For 
example, the function f(a) = V4 — «#2, x € [—2,2] satisfies the hypothesis of 
Rolle’s theorem, yet the derivative does not exist at —2 and 2. For x € (—2, 2), 


—2£ 
V4— 2?’ 


and the conclusion of Rolle’s theorem is satisfied with c = 0. 


f(a) = 


The Mean Value Theorem 


As a consequence of Rolle’s theorem we obtain the mean value theorem. This 
result is usually attributed to Joseph Lagrange (1736-1813). 


THEOREM 5.2.6 (Mean Value Theorem) /f f : [a,b] > R is continuous 
on [a,b] and differentiable on (a,b), then there exists c € (a,b) such that 


f(b) — F(a) = f'(e) (b- a). 


Graphically, the mean value theorem states that there exists at least one 
point c € (a,b) such that the slope of the tangent line to the graph of the 
function f is equal to the slope of the straight line passing through (a, f(a)) 
and (b, f(b)). For the function of Figure 5.4, there are two such values of c, 
namely c; and cg. 


Proof. Consider the function g defined on [a, b] by 
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Then g is continuous on [a, b], differentiable on (a,b), with g(a) = g(b). Thus 
by Rolle’s theorem there exists c € (a,b) such that g/(c) = 0. But 


g(a) = sa) F199) 


b= 
for all x € (a,b). Taking x = c gives f’(c) = Hate from which the 
—a 


conclusion now follows. 


fO)-f@ (.f()) 


Slope =~ 
ope a 


| 
I 
1 
| 
J 
' 
I 
I 
1 


FIGURE 5.4 
Mean value theorem 


The mean value theorem is one of the fundamental results of differential 
calculus. Its importance lies in the fact that it enables us to obtain information 
about a function f from its derivative f’. In Example 5.2.7 we will illustrate 
how the mean value theorem can be used to derive inequalities. Other appli- 
cations will be given later in this section and in the exercises. It will also be 
used in many other instances later in the text. 


EXAMPLE 5.2.7 In this example, we illustrate how the mean value theo- 
rem may be used in proving elementary inequalities. We will use it to prove 
that 


os Inil+2) <a for all «> -—l, 
1+ 


where In denotes the natural logarithm function. This function is considered 
in greater detail in Example 6.3.5 of the next chapter. Let f(x) = In(1 42), 
x € (—1,00). Then f(0) = 0. If x > 0, then by the mean value theorem, there 
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exists c € (0, x) such that 

In(l + x) = f(x) — f(0) = f'(c) x 
But f’(c) = (1+c)~! and (1+2)~1! < (1+c)7! < 1 for all c € (0,). Therefore 


x 
1l+a 


< f(a <a, 


and as a consequence 


x 
1+2 


<In(l+a) <a forall ax>0. 


Now suppose —1 < x < 0. Then again by the mean value theorem there exists 
c € (a,0) such that 


x 


In(1 +2) = f(x) - f(0) = ——. 


But since x < c < 0, we have 1 < (1+c)7! < (1+2)7}, and since zx is 
negative, 
x 
1l+2 
Hence the desired inequality holds for all x > —1, with equality if and only if 
x=0. 


<In(l+2) <a. 


The following theorem, attributed to Cauchy, is a useful generalization of 
the mean value theorem. 


THEOREM 5.2.8 (Cauchy Mean Value Theorem) /f f, g are contin- 
uous real-valued functions on [a,b] that are differentiable on (a,b), then there 
exists c € (a,b) such that 


Proof. Let 
h(x) = [F() — F@] 9() — [9) — 9(@)] F@). 
Then h is continuous on [a, }], differentiable on (a,b) with 
h(a) = f(b)g(@) — F(a)g(®) = h(b). 


Thus by Rolle’s theorem, there exists c € (a,b) such that h’(c) = 0, which 
gives the result. 


The geometric interpretation of the Cauchy mean value theorem is very 
similar to that of the mean value theorem. If g’(x) 4 0 for all x € (a,b), then 
g(a) # g(b) and the conclusion of Theorem 5.2.8 can be written as 


fO-f@ _ flO 


g(b)— gla) g’(e) 
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Q=(g@), f) 


P=(g(a), f@) 


FIGURE 5.5 
Cauchy mean value theorem 


Suppose « = g(t), y = f(t),a < t < b, is a parametric representation of a 
curve C in the plane. As t moves along the interval [a, b] the point (x, y) moves 
along C' from the point P = (g(a), f(a)) to Q = (g(b), f(b)). The slope of the 
line joining P to Q is given by [f(b) — f(a)]/[g(b) — g(a)] (see Figure 5.5). 
On the other hand, the quantity f’(t)/g'(t) is the slope of the curve C at the 
point (g(t), f(t)). Thus one meaning of Theorem 5.2.8 is that there must be 
a point on the curve C' where the slope of the curve is the same as the slope 
of the line joining P to Q. 


Applications of the Mean Value Theorem 


We now give several consequences of the mean value theorem. Additional 
applications are also given in the exercises. In the following, J will denote an 
arbitrary interval in R. 


THEOREM 5.2.9 Suppose f: I — R is differentiable on the interval I. 
(a) If f’(a) > 0 for alla € I, then f is monotone increasing on I. 
(b) If f'(a) 

(c) If f'(x) <0 for all x € I, then f is monotone decreasing on I. 
(d) If f'(x) <0 for alla € I, then f is strictly decreasing on I. 
(e) If f’(x) =0 for all x EI, then f is constant on I. 


>0 for alla € I, then f is strictly increasing on I. 


Proof. Suppose x1, r2 € I with x, < x2. By the mean value theorem applied 
to f on [x1, x9], 

f (x2) — f(@1) = f'(e) (w2 — 21) 
for some c € (21,22). If f’(c) > 0, then f(x2) > f(x). Thus, if f’(a) > 0 for 
all « € I, we have f(x2) > f(a1) for all x1, 2 € I with 2; < xg. Thus f is 
monotone increasing on J. The other results follow similarly. 
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Remark. It needs to be emphasized that if the derivative of a function f 
is positive at a point c, then this does not imply that f is increasing on 
an interval containing c. The function f of Exercise 20 satisfies f’(0) = 1, 
but f’(x) assumes both negative and positive values in every neighborhood 
of 0. Thus f is not monotone on any interval containing 0. If f’(c) > 0, the 
only conclusion that can be reached is that there exists a 6 > 0 such that 
f(x) < f(c) for all x € (c—6,c) and f(x) > f(c) for all a € (c,c+0) (Exercise 
17). This however does not mean that f is increasing on (c—6,c+06). However, 
if f’(c) > 0 and f’ is continuous at c, then there exists a 6 > 0 such that 
f'(x) > 0 for all x € (c— 6,c +6). Thus f is increasing on (c — 6,c+ 0). 

Theorem 5.2.9 is often used to determine maxima and minima of functions 
as follows: Suppose f is a real-valued continuous function on (a,b) and c € 
(a,b) is such that f’(c) = 0 or f’(c) does not exist. Suppose f is differentiable 
on (a,c) and (c, b). If f’(a) < 0 for all x € (a,c) and f’(x) > 0 for all x € (c,d), 
then by Theorem 5.2.9, f is decreasing on (a,c) and increasing on (c, b). As a 
consequence one concludes that f has a relative minimum at c. This method 
is usually referred to as the first derivative test for relative maxima or 
minima. The natural inclination is to think that the converse is also true; 
namely, if f has a relative minimum at c, then f is decreasing to the left of c 
and increasing to the right of c. This however, as the following example shows, 
is false! 


EXAMPLE 5.2.10 Let f be defined by 


1 
v4 (24+sin2), xz #0, 

f(z) = x 
0, x=0. 


The function f has an absolute minimum at x = 0; however, f’(a) has both 
negative and positive values in every neighborhood of 0. The details are left as 
an exercise (Exercise 21). The graph of f’(x) = 423(2+sin 1/x) — x? cos1/z), 
x #0, is given in Figure 5.6. 


The following theorem, besides being useful in computing right or left 
derivatives at a point, also states that the derivative (if it exists everywhere 
on an interval) can only have discontinuities of the second kind. 


THEOREM 5.2.11 Suppose f : [a,b) > R is continuous on [a,b) and dif- 
ferentiable on (a,b). If lim, f'(x) exists, then f' (a) exists and 
«wa 


fia) = im, f"(2). 


Proof. Let L = lim, f' (a), that is assumed to exist. Given € > 0, there exists 
mura 


a 6 > 0 such that 


|f'(z) -Ll| <e foralla,a<a<a+to. 
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FIGURE 5.6 
Graph of f’(x) = 473(2 + sin(1/x)) — x? cos(1/z), x #0 


Suppose 0 < A < 6 is such that a+h < b. Since f is continuous on [a,a+h] and 
differentiable on (a,a+h), by the mean value theorem f(a+h)—f(a) = f’(¢n)h 
for some ¢, € (a,a+h). Therefore 


f(a+h) = f(a) 
h 


for all h, 0 <h <6. Thus fi (a) = L. 


1 =f"(Cs) - L| <e 


EXAMPLES 5.2.12 (a) To illustrate the previous theorem, consider the 
function 

x? +1, wel, 

3-22, eg al 


For x < 1, f’(a) = 2x that has a left limit of 2 at « = 1. Thus by the theorem, 
Fo) = jim 2x = 2. 
Similarly, 
Eas jim, —2Qa = —2. 


(b) The converse of Theorem 5.2.11 is false. The function 
2 1 
x sin —, xz #0, 
x 
0, x=0, 


of Example 5.1.3(g) has the property that g’(0) exists but lim g'(x) does not. 
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Intermediate Value Theorem for Derivatives 


Our second important result of this section, due to Jean Gaston Darboux 
(1842-1917), is the intermediate value theorem for derivatives. The remarkable 
aspect of this theorem is that the hypothesis does not require continuity of 
the derivative. If the derivative were continuous, then the result would follow 
from Theorem 4.2.11 applied to f’. 


THEOREM 5.2.13 (Intermediate Value Theorem for Derivatives) 
Suppose I CR is an interval and f : I — R is differentiable on I. Then given 
a,b inI witha <b and a real number X between f'(a) and f'(b), there exists 
c € (a,b) such that f'(c) =X. 


Proof. Define g by g(x) = f(a) — Ax. Then g is differentiable on J with 
(2) = F'() — >. 

Suppose f’(a) < \ < f’(b). Then g/(a) < 0 and g’(b) > 0. As in the 
remark following Theorem 5.2.9, since g’(a) < 0 there exists an 7 > a such 
that g(%1) < g(a). Also, since g’(b) > 0, there exists an x2 < b such that 
g(x2) < g(b). As a consequence, g has an absolute minimum at some point 
c € (a,b). But then 


ie, f’(c) =X. 

The previous theorem is often used in calculus to determine where a func- 
tion is increasing or decreasing. Suppose it has been determined that the 
derivative f’ is zero at cy and cg with c, < co, and that f’(x) 4 0 for all 
x € (c1, C2). Then by the previous theorem, it suffices to check the sign of the 
derivative at a single point in the interval (ci, cg) to determine whether f’ is 
positive or negative on the whole interval (c,c2). Theorem 5.2.9 then allows 
us to determine whether f is increasing or decreasing on (ci, C2). 


Inverse Function Theorem 


We conclude this section with the following version of the inverse function 
theorem. 


THEOREM 5.2.14 (Inverse Function Theorem) Suppose I C R is an 
interval and f : I > R is differentiable on I with f'(a) 4 0 for alla € I. Then 
f is one-to-one on I, the inverse function f—' is continuous and differentiable 


on J = f(L) with 


for alla € I. 


Proof. Since f’(x) 4 0 for all x € I, by Theorem 5.2.13, f’ is either positive 
on I, or negative on J. Assume that f’(x) > 0 for all x € I. Then by Theorem 
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5.2.9, f is strictly increasing on I and by Theorem 4.4.12 f~! is continuous 
on J = f(L). 

It remains to be shown that f~+ is differentiable on J. Let yo € J, and 
let {yn} be any sequence in J with yn, > yo, and yn # Yo for all n. For 
each n, there exists x, € I such that f(an) = yn. Since f~! is continuous, 
In + Zo = f—'(yo). Hence 


in f7'Wn) = Fe" ue) fiat In — Xo 
N=Te Yn — Yo noo f(&n) — f (Xo) 
1 
™ Pla) 


Since this holds for any sequence {yp} with Yn — Yo, Yn # Yo, by Theorem 
4.1.3 and the definition of the derivative 


eee ae 
(f ) (Yo) = Pas): 


Remark. The hypothesis that f’(x) 4 0 for all x € I is crucial. For example, 
the function f(a) = x? is strictly increasing on [—1,1] with f’(0) = 0. The 
inverse function f—!(y) = y'/* however is not differentiable at y = 0. 


EXAMPLES 5.2.15 (a) As an application of the previous theorem we show 
that f(x) =2!/", x € (0,00), n EN, is differentiable on (0,00) with 


fi() = oat 


for all a € (0,00). Consider the function g(x) = 7”, n € N, Domg = (0,00). 
Then g/(x) = nx"! and g'(x) > 0 for all x € (0,00). By the previous theorem 
g_' is differentiable on J = g((0,0o)) = (0,00) with 


(7 Y(@(«) = = — 


ge) nat 


If we set y = g(x) = 2”, then x = y* and 
(9"')'y) = —. > = 


Since f = g~' the desired result follows. 

(b) As in Example 5.2.7, let L(x) = Inax denote the natural logarithm 
function on (0, 00). Since L/(x) = 1/z is stricly positive on (0, 00), the function 
L is one-to-one, the inverse function L~! is continuous on R = Range L, and 
by Theorem 5.2.14, 
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If we set E = L~1, then E’(L(x)) = a, or E'(y) = E(y) where y = L(z). 
The function E(x), x € R is called the natural exponential function on R 
and is usually denoted by e”, where e is Euler’s number of Example 3.3.5. The 
exponential function F(a) is considered in greater detail in Example 8.7.20(d). 


(c) In this example, we consider the inverse function of g(a) = cosa, x € 
[0,7]. Since g'(x) = —sin is strictly negative for x € (0,7), the function g 
is strictly decreasing on [0,7] with g([0,7]) = [—1,1]. Thus for y € [—1,]], 
x = arccos y if and only if cosa = y. Finally, since g’(a) 4 0 for x € (0,7), by 
the inverse function theorem 


(o°)' (o(e)) = 7 = = 
G = — = = ; 
: g(t) —sing V/1—cos?z 
or since y = cosa, 
-1 
— arccosy = —————=.. 
dy viv 


Exercises 5.2 
1. Graph the function f(x) = (x — 4)’, 0 < a < 2. Show that f{.(0) =—1 
and f! (2) =3. 


2. Which of the following functions satisfy the hypothesis of the mean value 
theorem. For those to which the mean value theorem applies, calculate a 


suitable c. 
a. f(x) = |z|, -2<a4<2 b. f(x) = 2a —2°,0<a<2 
e. f(a) = 5, 1S 282 d. f(z) =1—-2?, -2<a<1 


3. For each of the following functions determine the interval(s) where the 
function is increasing, decreasing, and find all local maxima and minima. 


*a. f(z) = 22 +62—5, «ER. b. g(a) =42—2*, «ER. 
2 

*e Me) = ceR. d. k(x) = Vz—42, «20. 

*e. (a) = 2+ 5, x #0. f. f(e) = =a b,a#b 


n 


4. Let f(x) = So (a-ai)’, where a1, @2, ...,@n are constants. Find the value 
i=l 
of x where f is a minimum. 


5. As in Example 5.2.7 use the mean value theorem to establish each of the 
following inequalities. 


*a, JI +a<1l+ia, x>-1 

boc” >1l+a2, cER 

*e, c* —a® <aa® '(x%—a), O<a<a, 0<a<l 
di (l+a2)*>1+az, r>-1, a>l 


lFor a EN, this inequality was proved by mathematical induction in Example 1.3.2(b). 


d 
In this exercise and in Exercise 6(b) you may assume that for a € R, ao =are—!, 
xv 
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10. 


11. 


12. 


13. 


14. 
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Prove each of the following inequalities. 
*a ay hs (ab), Be bot,. weEN,, w> 2. 
*b. a%b'-* <aa+(l—a)b, a,b>0, O<a<1 


(Second Derivative Test) Let f : [a,b] > R be differentiable on (a, b). 
Suppose c € (a,b) is such that f’(c) = 0, and f’(c) exists. 


*a. If f’(c) > 0, prove that f has a local minimum at c. 
b. If f’(c) < 0, prove that f has a local maximum at c. 
c. Show by examples that no conclusion can be made if f”(c) = 0. 


*Suppose f : (a,b) > R satisfies | f(x) — f(y)| < M |x — y|~ for some 
a> 1 and all x,y € (a,b). Prove that f is a constant function on (a,b). 


*Find a polynomial P(x) of degree less than or equal to 2 with P(2) = 0 
such that the function 


2 
x, a<l, 
f(x) = 
P(x), z>I, 
is differentiable at x = 1. 
*Let g be defined by 
2sin x + cos 2x, x<0, 
g(z)=4 5 
ax” + baz+c, x>0. 
Determine the constants a, b, and c such that g’(0) and g’(0) exist. 


a. Suppose f is differentiable on an interval J. Prove that f’ is bounded 
on J if and only if there exists a constant M such that |f(x) — f(y)| < 
M |x — y| for all x,y € I. 


b. Prove that | sinxz — siny| < |x — y| for all z, y ER. 
c. Prove that |,/x — /y| < sale — y| for all x,y € [a, 00), a > 0. 
*a. Show that tana > x for x € (0, $]. 


*b. Set 
sin x = 
feyad 0.51 
1, x=0. 


Show that f is strictly decreasing on (0, $]. 


2 
c. Using the result of part (b), prove that —x < sina < a for all 
T 
x € (0, $]. 
Give an example of a uniformly continuous function on [0,1] that is dif- 
ferentiable on (0,1) but for which f’ is not bounded on (0,1). 


*a, Suppose f’(x) exists for all ~ € (a,b). Let c € (a,b). Show that 
there exists a sequence {xp} in (a,b) with z, #c and xz, — c such that 


f'(@n) > f'(): 


b. Does f’(xn) > f’(c) for every sequence {rn} with rn — c? 
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15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 
24. 


Let f,g : [0,00) — R be continuous on [0,0co) and differentiable on 
(0,00). If f(0) = g(0) and f’(x) > g'(x) for all x € (0,00), prove that 
f(x) > g(x) for all x € [0, 00). 


A differentiable function f : [a,b] > R is uniformly differentiable on 
[a, b] if for every € > 0 there exists a 6 > 0 such that 


LOWS) — f' (2) <e 


for all t,x € [a,b] with 0 < |f-— 2] < 6. Show that f is uniformly 
differentiable on [a,b] if and only if f’ is continuous on [a, b]. 


*Suppose f : [a,b] > R with f(a) > 0. Prove that there exists a 5 > 0 
such that f(x) > f(a) for alla,a<a<a+to. 


Prove that the equation x? — 32 + b = 0 has at most one root in the 
interval [—1, 1]. 


*Suppose g is differentiable on (a,b) with |g’(x)| < M for all x € (a,b). 
Prove that there exists an € > 0 such that the function f(x) = «+ € g(a) 
is one-to-one on (a, b). 


Let 
2 1 
a+ 2x° sin —-, xz #0, 
x 
0, xr=0. 
a. Show that f’(0) = 1. 


*b. Prove that f’(x) assumes both positive and negative values in every 
neighborhood of 0. 


Let f be defined by 


ot(2+sin2), x #0, 
x 
0, xr=0. 


f(x) = 


a. Show that f has an absolute minimum at x = 0. 


b. Show that f’(x) assumes both negative and positive values in every 
neighborhood of 0. 


Let f(x) = 27, g(x) = 2°, x € [-1, 1]. 
a. Find c € (—1,1) such that the conclusion of Theorem 5.2.8 holds. 
b. Show that there does not exist any c € (—1,1) for which 
fY-#-D _ £O 
g(1)—g9(-1) — g’(e) 
For r € Q and x > 0, let f(x) = x”. Prove that f’(x) =ra”~'. 


Suppose L : (0,00) > R is a differentiable function satisfying L’(x) = 1/x 
with L(1) = 0. Prove each of the following: 


*a. L(ab) = L(a) + L(b) for all a, b € (0,00) 
b. L(1/b) = —L(b), b>0 
*c. L(b") =rL(b), b>0,r ER 
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d. L(e) = 1, where e is Euler’s number 
e. RangeL = R 
25. Let g(x) = tana, -$ <a < §. 


a. Show that g is one-to-one on (—$, 5) with Range g = R. 


*b. Let arctanz, x € R, denote the inverse function of g. Use Theorem 
5.2.14 to prove that 
e arctan 7 = 
dx 14a?" 
c. Sketch the graph of tanz and arctan z. 
26. a. Show that f(x) = sing is one-to-one on [—$, 5] with f([-§, 4]) = 
b. For « € [—1, 1], let arcsin x denote the inverse function of f. Show that 
arcsin x is differentiable on (—1,1) and find the derivative of arcsin x. 


27. Let f : (0,00) > R be differentiable on (0,00) and suppose that 
lim f’(x) = L. 


LZ 0CO 


fe+h)— f(a) _ 


a. Show that for any h > 0, lim 
=—00 h 


b. Show that lim f(@) =f, 


x2->o0o 6 


5.3 L’Hospital’s Rule 


As another application of the mean value theorem we now prove l’Hospital’s 
rule for evaluating limits. Although the theorem is named after the Marquis 
de Hospital (1661-1704), it should more appropriately be called Bernoulli’s 
rule. The story is that in 1691, Hospital asked Johann Bernoulli (1667-1748) 
to provide, for a fee, lectures on the new subject of calculus. L’Hospital subse- 
quently incorporated these lectures into the first calculus text L’Analyse des 
infiniment petis (Analysis of infinitely small quantities) published in 1696. 
The initial version (stated without the use of limits) of what is now known as 
V’Hospital’s rule first appeared in this text. 


Infinite Limits 
Since l’Hospital’s rule allows for infinite limits, we provide the following defi- 


nitions. 


DEFINITION 5.3.1 Let f be a real-valued function defined on a subset E 
of R and let p be a limit point of E. We say that f tends to co (or diverges 
to oo) as x approaches p, denoted 


lim f(x) =o, 


xp 
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if for every M ER, there exists a 6 > 0 such that 
f(z) >M forallxe FE with 0<|a—p| <6. 
Similarly, 
lim f(z) = —oo, 
2p 


if for every M ER, there exists a 6 > 0 such that 


f(a) <M forallacE with 0<|a—pl <6. 


For f defined on an appropriate subset F of R it is also possible to define 
each of the following limits: 


lim f(#)=+00, lim f(x)=+00, lim f(x)=+00, lim f(#) =+0. 
xz—pt Lp B00 

Since these definitions are similar to Definitions 4.1.11 and 4.4.1 they are left 
to the exercises (Exercise 1). 

Remark. Since we now allow the possibility of a function having infinite 
limits, it needs to be emphasized that when we say that a function f has a 
limit at p € R (or at too), we mean a finite limit. 


L’Hospital’s Rule 


L’Hospital’s rule is useful for evaluating limits of the form 


lim f(a) 


tp g(x) 


where either (a) lim f(x) = lim g(x) = 0 or (b) f and g tend to too as x > p. 
=p =p 
If (a) holds, then lim (f(z)/g(a)) is usually referred to as indeterminate of 


P 
form 0/0, whereas in (b) the limit is referred to as indeterminate of form oo/oo. 
The reason that (a) and (b) are indeterminate are that previous methods may 
no longer apply. 

In (a), if either ues f(x) or iy g(x) is nonzero, then previous methods 
discussed in Section 4.1 apply. For example, if both f and g have limits at p 
and Ls g(x) #0, then by Theorem 4.1.6(c) 


lim *) — mF) 
ep g(x) lim g(z) 


On the other hand, if lim f(#) = A 40 and g(x) > 0 with lim g(x) = 0, then 
Lp zp 


as « + p, f(x)/g(x) tends to oo if A > 0, and to —oo if A < 0 (Exercise 5). 
However, if lim f(x) = lim g(a) = 0, then unless the quotient f(x)/g(x) can 
Lp «up 


somehow be simplified, previous methods may no longer be applicable. 
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THEOREM 5.3.2 (L’Hospital’s Rule) Suppose f, g are real-valued dif- 
ferentiable functions on (a,b), with g(x) # 0 for all x € (a,b), where 
—o <a<b<o. Suppose 


Owe 


asat g’ (x) 


; where LE RU {—co, co}. 


If 
(a) lim f(x) =0 and im g(x) =0, or 


asat 


(b) lim g(x) = +00, then 
xz—at 


lim fla) =f. 

zat g(x) 
Remark. The analogous result where x — b~ is obviously also true. A more 
elementary version of |’Hospital’s rule that relies only on the definition of 
the derivative is given in Exercise 2. Also, Exercise 7 provides examples of 
two functions f and g satisfying (a) for which lim (f(x)/g(z)) exists but 


lim (f"(«)/9'(«)) does not exist. 


Proof. Suppose (a) holds. We first prove the case where a is finite. Let {xp } 
be a sequence in (a,b) with x, > a and x, 4 a for all n. Since we want to 
apply the generalized mean value theorem to f and g on the interval [a, x,], 
we need both f and g continuous at a. This is accomplished by setting 


f(a) = g(a) = 90. 


Then by hypothesis (a), f and g are continuous at a. Thus by the generalized 
mean value theorem, for each n € N there exists c, between a and x, such 
that 


[f (an) — F(a)]9’ (en) = (gan) — g(a] F'(en)s 


f(@n) _ f'(en) 

g(£n) g' (en) 
Note, since g'(x) # 0 for all x € (a,6), g(an) 4 g(a) for alln Asn > ~w, 
Cn — at. Thus by Theorem 4.1.3 and the hypothesis, 


ek NL ac. PGs. FO) 


noo g(in) — n-00 g'(Cn) eat g'(x) 


or 


Since the above holds for every sequence {x,} with rv, — at, the result 
follows. 


Suppose a = —oo. To handle this case, we make the substitution « = —1/t. 
Then as t + 07, + —oo. Define the functions y(t) and w(t) on (0,c) for 
some c > 0 by 


p(t) =f(-1/t) and Y(t) = g(-1/t). 
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We leave it as an exercise (Exercise 3) to verify that 


gt) £@) _ 
0 WE) toe g(a) 


and that 
Thus by the above, 


roo g(x) 140+ W(t) 


Suppose now that (b) holds, i.e., lim, g(x) = oo. The case where g(x) > 
«wa 
—oo is treated similarly. Rather than treating the finite case and infinite case 
separately, we provide a proof that works for both. 
Suppose first that —oo < L < oo, and 6 € R satisfies 6 > L. Choose r 
such that LD <r < 6. Since 
f(a) 


lim ——~ <r, 
poet g(a) ‘ 


there exists c; € (a,b) such that 


f'(Q) 
g'(S) 


Fix ay, a<y <c,. Since g(x) + oo as x > a, there exists a co, a < co < y, 
such that g(x) > g(y) and g(x) > 0 for all , a < & < cg. Let x € (a,c2) be 
arbitrary. Then by the generalized mean value theorem, there exists ¢ € (2, y) 
such that 


<r forall G,a<¢€<«q. 


f)-fy) _ FM 
g(a) at) 9) <" e 
Multiplying (4) by (g(x) — g(y))/g(), which is positive, we obtain 


f(x) - AO <r (1 an), 


g(x) g(x) 
ia fle). f@) , alu) 
oot te) - 
for all x, a < x < cy. Now for fixed y, since g(x) > oo, 
lim fy) = lim g(y) = 
a—at g(x) asat g(x) 
Therefore 
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Thus there exists c3, a < cg < C2, such that 
fw) ,, (1 aH) ba 


for all , a < x < cg. Thus by (5), 


f(x) 


~~ <6 forall tz,a<a<c3. (6) 


g(x) 


If L = —oo, then for any 8 € R, there exists cz such that (6) holds for all 
x,a<x< cg. Thus by definition, 


mm £2) 
aa g(x) ve 


If L is finite, then given € > 0, by taking 6 = L + «, there exists cg such that 
f(«) 


—~<L+e forall tia<u<c. (7) 


g(x) 


Suppose —oo < L < oo. Let a € R, a < L be arbitrary. Then an argument 
similar to the above gives the existence of cs € (a,b) such that 


f(x) 


——_>a forall z,a<4<cy. 


g(x) 


If L = o, then this implies that 


(x) 


asat g(x) = 


On the other hand, if L is finite, taking a = L — € gives the existence of a c; 
such that 
f(x) 


——>L-e forall z.a<ar<c. 
g(x) 
Combining this with (7) proves that 
f(x) 


1 a 


zat g(x) 


Remarks. (a) The proof of case (a) could have been done similarly to that of 
(b), treating the case where a is finite and —oo simultaneously. I chose not to 
do so since making the substitution « = —1/t is a useful technique, reducing 
problems involving limits at —oo to right limits at 0. Conversely, limits at 0 
can be transformed to limits at too with the substitution x = 1/t. These 
new limits are in many instances easier to evaluate than the original. This is 
illustrated in Example 5.3.4(c). 
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(b) In hypothesis (b) we only required that lim, g(x) = too. If lim (x) 
«La wa 
is finite, then it immediately follows that 


f(x) 


asat g(x) a 


bi 


and l’Hospital’s rule is not required (Exercise 4). Thus in practice, hypothesis 
(b) of ’Hospital’s rule is used only if both f and g have infinite limits. 

For convenience we stated and proved l|’Hospital’s rule in terms of right 
limits. Since the analogous results for left limits are also true, combining the 
two results gives the following corollary. 


COROLLARY 5.3.3 (L’Hospital’s Rule) Suppose f,g are real-valued 
differentiable functions on (a, p)U(p, b), with g(a) £0 for alla € (a,p)U(p, 6), 
where —o0o <a<b< ow. Suppose 


: where Le RU {—o0, oo}. 


If 
(a) _ lim f(x) = lim g(x) =0, or 


(b) lim g(x) = +00, then 


In(1 
EXAMPLES 5.3.4 (a) Consider_lim, awe) 
x2—0 x 
logarithm function on (0,00). This limit is indeterminate of form 0/0. With 
f(x) =In(14+ 2) and g(x) = 2, 
/ 
Hig A a =1 
as0t g(a) xa0+ L+ a 


, where In is the natural 


In(1 +2) 
x 
Although l’Hospital’s rule provides an easy method for evaluating this 

limit, the result can also be obtained by using previous techniques. In Example 

5.2.7 we proved that 


Thus by l’Hospital’s rule lim =1. 
a—0r 


x 
—_ <ln(1+ < 
eet n( u<au 

for all « > —1. Thus 

1 In(1 4+ 2) 
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In(1 
biel 3.0 Thieby Thasenene aa Eo 
a—O0+t x 
1—cosxz 


(b) In this example, we consider lim : 
x—0 ag 


form 0/0. If we apply l’Hospital’s rule we obtain 


. This is indeterminate of 


which is again indeterminate of form 0/0. However, applying |’Hospital’s rule 
one more time gives 


i COS X& 1 
im = 
x20 2 2 
1—cosz 
. Therefore lim ——.— = $. 
x0 2 
(c) Consider 
7 
‘ Ee = 
lim 
2 s0t 2£ 


Since lim, e-/* — 0, the above limit is indeterminate of form 0/0. If we 
«x0 


apply ’Hospital’s rule we obtain 


a|FR 


lim —— 
0 x2’ 

and this limit is more complicated than the original limit. However, if we let 
t =1/a, then 


a+0t & t—+00 ef 
This limit is indeterminate of form 00/00. By l’Hospital’s rule 
t 1 


lim — = lim — =0. 
t00 € too et 


Therefore, lim eV? |e = 0. 
z—0t 


Exercises 5.3 


1. Provide definitions for each of the following limits: 
a. (x) = oo. b. Jim, f(x) =o. 

2. *Suppose f, g are differentiable on (a,b), to € (a,b) and g’(xo) # 0. If 
f(@o) = g(Xo) = 0, prove that 


a £2) _ £'@o) 


eo g(a) gy! (ao) 
(Hint: apply the definition of the derivative.) 
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be defined on (—oo, b). Show that there exists a c > 0 such that 


3. Let h(x) 
= h(—1/t) is defined on (0,0), and that lim h(x) = lim y(t). 
a—+—00 tot 


p(t) 
4. *Let f,g be real-valued functions defined on (a, b). If lim, f(a) exists in 
x@“—a 
Rand lim g(x) = oo, prove that 
rat 


f(x) _ 


asat g(x) 
5. Suppose f, g are real-valued functions on (a, b) satisfying lim, f(x) = 
@L“-a 


AF 0, lim, g(x) = 0, and g(x) > 0 for all x € (a,b). If A > 0, prove 
ra 
that 


f(x) _ 
im 
asat g(x) 
6. Use l’Hospital’s rule and any of the differentiation formulas from calculus 
to find each of the following limits. In the following, Inz, x > 0 denotes 


the natural logarithm function. 


*a, lim & + 22-3 | b. lim we 4 2n—-3 
a1 2473 — x? — 1° “p31 2e3 +2 +17 
*e. lim in d. lim Aeoeee 
zoo mis ‘eae 
*e. lim 2° In,x wherea> 0. f. lim In(l +2) 
x—+0+F z>0 sinz 
] Ina)? 
*e. lim (ne). where a > 0. h. lim a p,qgER. 
xL—>0O ex ~—>0o ed 
1 1 
*i. lim ( a a; j. lim x'/* 
x >0t \& sin x 2-400 
7. Let f(x) = 2? sin(1/x) and g(x) = sina. Show that lim oe exists but 
2 g v4 ae 
iz 
that lim f() does not exist. 
20 g'(& 
_, Piz) ; 
8. Investigate lim qa)’ where p and q are polynomials of degree n and m, 
x@2—oo qd fi 
respectively. 


9. Let f(x) = (sinx)/ax for « £0, and f(0) =1 
*a. Show that f’(0) exists, and determine its value. 
*b. Show that f’’(0) exists, and determine its value. 
10. Let f be defined on R by 
ae, x #0, 
I) = 0, x=0. 
Prove that f”)(0) = 0 for all n = 1, 2,.... 
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5.4 Newton’s Method? 


In this section, we consider the iterative method, commonly known as New- 
ton’s method, for finding approximations to the solutions of the equation 
f(x) = 0. Although the method is named after Newton, it is actually due 
to Joseph Raphson (1648-1715) and in many texts the method is referred to 
as the Newton-Raphson method. Newton did derive an iterative method for 
finding the roots of a cubic equation; his method however is not the one used 
in the procedure named after him. That was developed by Raphson. 

Suppose f is a continuous function on [a,b] satisfying f(a) f(b) < 0. Then 
f has opposite sign at the endpoints a and b and thus by the intermediate 
value theorem (Theorem 4.2.11) there exists at least one value c € (a,b) for 
which f(c) = 0. If in addition f is differentiable on (a,b) with f’(#) 4 0 for 
all x € (a,b), then f is either strictly increasing or decreasing on [a,b], and in 
this case the value c is unique; that is, there is exactly one point where the 
graph of f crosses the x-axis. 

An elementary approach to finding a numerical approximation to the value 
c is the method of bisection. For this method, differentiability of f is not 
required. To illustrate the method, suppose f satisfies f(a) <0 < f(b). Let 


1 
C= 5 (4 + b). 
If f(c1) = 0, we are done. If f(c1) # 0, then c belongs to one of the two 
intervals (a,ci) or (c1,b), and thus |c, — c| < $(b— a). Suppose f(c1) > 0. 
Then c € (a,c1), and in this case we set co = a and 
1 
C2 = 3 (co +1). 
If f(c2) = 0, we are done. If not, then suppose f(co) < 0. Then c € (c2,¢1), 
and as above we set 1 


C3 = x(Cy + Cg). 
5 = 5 +e) 
In general, suppose cj, C2,...,Cn, m > 2, have been determined. If by happen- 


stance f (cp) = 0, then we have obtained the exact value. If f(¢n—1)f (en) < 0, 
then c lies between c,_; and c,, and we define 


1 
Cn4t1 = 3 (en =F Cn—1): 


On the other hand, if f(cn-1)f (en) > 0, then c lies between c,, and cy—2, and 
in this case, we define 


1 
Cn4+1 = 3 (en + Cn—2): 


?The topics of this section are not required in subsequent chapters. 
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FIGURE 5.7 
Newton’s method 


This gives us a sequence {c,,} that satisfies 
1 
len — | < 55 (b- a), 
and thus lim c, =. 
n> co 

Although this method provides a sequence of numbers that converges to 
the zero of f, it has the disadvantage that the convergence is rather slow. 
An alternate method, due to Raphson, uses tangent lines to the curve to find 
successive points c, approximating the zero of f. As we will see, this method 
will often converge much more rapidly to the solution. 

As above, assume that f is differentiable on [a,b] with f(a)f(b) < 0 and 
f'(x) #0 for all x € [a,b]. Let c, be an initial guess to the value c. The line 
tangent to the graph of f at (c1, f(c1)) has equation given by 


y= fla fl (ea = Gy). 
Since f’(c,) 4 0, the line crosses the z-axis at a point that we denote by co 
(Figure 5.7). Thus 

0= fle) + f (c)(e2 — e1), 


that upon solving for cz gives 


f(er) 

f(r) 

We now replace the point c; by the second estimate c2 to obtain c3, and so 
forth. Inductively, we obtain a sequence {c,} given by the formula 


_ F(en) _ 
Cn41 = Cn — Filen)’ WH 1,25 c., (8) 


Cg = cy — 
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where c; is an initial guess to the solution f(c) = 0. As we will see, under 
suitable hypothesis, the sequence {c,,} will converge very rapidly to a solution 
of the equation f(x) = 0. Before we prove the main result, we illustrate the 
above with an example. 


EXAMPLE 5.4.1 Let a> 0 and consider the function 
f(x) = 2? —a. 


If a > 1, then f has exactly one zero on [0, a], namely /a. If 0 < a < 1, then 
the zero of f lies in [0,1]. Let c; be an initial guess to /a. Then by formula 


(8), forn > 1, 
7 e-a_ il _ a 
Cn+1 = Cn en => 2 Cn ‘ 


This is exactly the sequence of Exercise 6 of Section 3.3, where the reader 
was asked to prove that the sequence converges to ,/a. With a = 2, taking 
c, = 1.4 as an initial guess, yields 


Cy = 1.4142857, 
c3 = 1.4142135, 


which is already correct to at least seven decimal places. 


THEOREM 5.4.2 (Newton’s Method) Let f be a real-valued function on 
[a, b] that is twice differentiable on [a,b]. Suppose that f(a)f(b) < 0 and that 
there exist constants m and M such that |f’(x)| > m > 0 and |f"(a)| < M 
for all x € [a,b]. Then there exists a subinterval I of [a,b] containing a zero c 
of f such that for any c, € I, the sequence {c,} defined by 


cia Tem neéN, 
is in I, and lim cy, =c. Furthermore, 
noo 
M 
lens — el < 5 len — oP. (9 


Prior to proving Theorem 5.4.2 we first state and prove the following 
lemma. The result is in fact a special case of Taylor’s theorem (8.7.16) that 
will be discussed in detail in Chapter 8. 


LEMMA 5.4.3 Suppose f : [a,b] + R is such that f and f' are continuous 
on [a,b] and f(x) exists for all x € (a,b). Let xo € [a,b]. Then for any 
x € [a,b], there exists a real number ¢ between xo and x such that 


F(a) = Flo) + F(wo)(@— 20) + 54" (CN — 20) 
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Proof. For x € [a,}], let a € R be determined by 
f(x) = f (xo) + f'(ao)(@ — 20) + a(a — 29)”. 
Define g on [a,b] by 
g(t) = f(t) — f(x) — f'(xo)(t — 20) — a(t — x0)’. 


If 2 = xo then the conclusion is true with ¢ = a. Assume that x > x9. Then 
g is continuous and differentiable on [xo, 2] with g(vo) = g(x) = 0. Thus by 
Rolle’s theorem there exists c; € (%o,z) such that g/(c) = 0. But 


g(t) = F(t) — f'(wo) — 2a(t — xo). 


By hypothesis g’ is continuous on [29, c], differentiable on (ao, c), and satisfies 
g'(xo) = g'(c) = 0. Thus by Rolle’s theorem again, there exists ¢ € (20, c) 
such that g’(¢) = 0. But 


g(t) = f"(t) — 2a. 


Therefore a = $f’’(¢) 


Proof of Theorem 5.4.2 Since f(a)f(b) < 0 and f’(a) 4 0 for all x € [a,b], 
f has exactly one zero c in the interval (a, b). 


Let zo € [a, b] be arbitrary. By Lemma 5.4.3 there exists a point ¢ between 
c and xo such that 


0= Flo) = Flav) + F'(a0)(~ 20) + 5F"(Ole- a0)’ 


—f (20) = F'(wo)(e— 0) + 5 FO = 20)?. (10) 

If x1 is defined by 
£1 = £0 f (xo) 
f'(xo)’ 
then by equation (10) 
“1 =X) +(c—20) + a TERT t0)° 

Therefore LiPo) i 

|r C| = 2 |f"(x0)| lc |? = reals aol’. (11) 


Choose 6 > 0 so that 6 < 2m/M and I = [c— 6,c+ 6] C [a,b]. If c, € I, then 
|c— Cpy| < 6. If x41 is defined by (8), then by (11) 


M 
\Cn-+1 a c| < oa < é. 
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(cy, f(ey)) 


(cz, f(e2)) 


FIGURE 5.8 
An illustration of Remark (c) 


Therefore c,+41 € J. Thus if the initial choice cy € I, cy, € I for all n = 2,38,.... 


It remains to be shown that lim c, = c. If c, € J, then by induction 
noo 


M ” 
lCn41 —¢| < om» ler — cl. 
m 


M 
But by our choice of 6, om? <1, and as a consequence cn > c¢. 
m 


Remarks. (a) For a given function f satisfying the hypothesis of the theorem, 
the constants M and m, and thus 6 can be determined. To determine the 
interval J, one can use the method of bisection to find an approximation 2,, 
to c satisfying |v, — %p,_1| < 6. If c is taken to be w,, then |c; — c| < 06. 
In practice however, one usually makes a judicious guess for c; and proceeds 
with the computations. 


(b) Let e,, = c—c, be the error in approximating c, and let K = M/2m. 
Then inequality (9) can be expressed as 


len+1| aS K len”. 


Consequently, if Jen| < 10~™, then Jen41| < K10~°”. Thus, except for the 
constant factor K, the accuracy actually doubles at each step. For this reason, 
Newton’s method is usually referred to as a second order or quadratic 
method. 


(c) Even though Newton’s method is very efficient, there are a number of 
things that can go wrong if c; is poorly chosen. For example, in Figure 5.8, 
the initial choice of c, gives a cz outside the interval, and the subsequent cy, 
tend to —oo. Such a function is given by f(x) = 2/(z? +1). In Figure 5.9, the 
initial choice of c,; causes the subsequent values to oscillate between c; and 


cg. A function having this property is given by g(a) = «— zx, Taking c, = 1 
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(ey. fle) 


= (€2, fleE2)) 


FIGURE 5.9 
An example of oscillating c, and c2 


gives cg = —1, c3 = 1, etc. For this reason, the initial choice of c, for many 
functions has to be sufficiently close to c in order to be sure that the method 
works. 


Exercises 5.4 


ile 


*For a > 0, apply Newton’s method to f(x) = x?—a to obtain a sequence 
{cn} that converges to the cube root of a. 
Use Newton’s method to find approximations to the roots, accurate to 
six decimal places, of the given functions on the interval [0, 1]. 
*a. f(x) = 2? —3a+1. b. f(z) = 3a3 — 5a? +1 

c. f(x) = 8a° — 82? +1. 
Use Newton’s method to approximate the real zeros of f(x) = «4 —42—3 
accurate to four decimal places 
Show that f(x) = Inx—2+3, x € (0,00) has two real zeros. Use Newton’s 
method to approximate them accurate to four decimal places. 
Let f : [a,b] > R be differentiable on [a, b] with f(a) < 0 < f(b). Suppose 
there exist constants m and M such that 0 < m < f’(x) < M for all 
x € [a,b]. Let ci € [a,b] be arbitrary, and define 
(en) 

ae 
Prove that the sequence {cn} converges to the unique zero of f on [a, 5]. 
(Hint: Consider the function g(x) = x — f(x)/M.) 


Cn+1 = Cn — 


219 


Notes 


Without question the most significant result of this chapter is the mean value theo- 
rem. The simplicity of its proof disguises the importance and usefulness of the result. 
The theorem allows us to obtain information about the function from its derivative. 
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This has many applications as was illustrated by the subsequent theorems and ex- 
ercises. Additional applications will be encountered throughout the text. 

Although the mean value theorem is attributed to Lagrange, his proof, that ap- 
peared around 1772, was based on the false assumption that every function could be 
expanded in a power series. Cauchy, in his 1823 text Résumé des Lecons donnees a 
L’Ecole Royale Polytechnique sur le Calcul Infinitésimal, used the modern definition 
of the derivative to provide a proof of the mean value theorem. His statement and 
proof of the theorem however differs from the version in the text in that he assumed 
continuity of the derivative. What Cauchy actually proved was that if f’ is contin- 
uous on [a,b], then the quantity {f(b) — f(a)}/{b — a} lies between the minimum 
and maximum values of f’ on [a,b]. (See Miscellaneous Exercise 4.) Then by the 
intermediate value theorem (Theorem 4.2.11) applied to the continuous function f’, 
there exists c € (a,b) such that 


f(b) — f(a) = f'()(— a). 


It is worth noting that our proof of the mean value theorem depends ultimately on 
the completeness property of R (through Rolle’s theorem and Corollary 4.2.9). 

The mean value theorem can justifiably be called the fundamental theorem of 
differential calculus. It allowed the development of rigorous proofs of many results 
that were previously taken as fact or “proved” from geometric constructions. Al- 
though the modern proof of l’Hospital’s rule uses the mean value theorem, it should 
be remembered that the original version for calculating the limit of a quotient where 
both the numerator and denominator become zero first appeared in 1696, 70 years 
before Lagrange’s proof of the mean value theorem. The original version was stated 
and “proved” in a purely geometric manner without reference to limits. For further 
details, including a history of calculus, the reader is referred to the text by Katz 
listed in the Bibliography. 

The Bernoulli brothers, Jakob (1654-1705) and Johann (1667-1748) were among 
the first mathematicians in Europe to use the new techniques of Newton and Leib- 
niz in the study of curves and related physical problems. Among these were finding 
the equations of the catenary and isochrone.’ Both brothers also contributed to the 
study of differential equations by solving the Bernoulli equation y'+P(x)y = Q(x)y”. 
Through their numerous publications and correspondence with other mathemati- 
cians the Bernoulli brothers helped to establish the utility of the new calculus. The 
first text on differential calculus by l’Hospital also contributed significantly to pop- 
ularizing the subject. 

Leonhard Euler (1707-1783), one of the most prolific mathematicians in his- 


tory, contributed significantly to establishing calculus as an independent science. 
Even though the calculus of exponential and logarithmic functions was basically 
developed by Johann Bernoulli, it was Euler’s expositions on these topics in the 
eighteenth century that brought them into the mainstream of mathematics. Much 
of what we know today about the exponential, logarithmic and trigonometric func- 
tions is due to Euler. He was also among the first mathematicians to define the 
concept of a function. However to Euler, as for the other mathematicians of that 


3The catenary problem involves finding the equation of a freely hanging cable, whereas 
the isochrone problem involves finding the equation of a curve along which an object would 
fall with uniform vertical velocity. 
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period, a function was one that had a power series expansion. It is important to note 
that most mathematicians of the eighteenth century, including Euler, were primarily 
concerned with computations needed for the applications of calculus; proofs did not 
gain prominence until the nineteenth century. For this reason, numerous results of 
that era that were assumed to be true were subsequently proved to be true only 
under more restrictive conditions. 


Miscellaneous Exercises 


1. Let f: (a,b) > R and suppose f” exists at xo € (a,b). Prove that 
f(@o +h) + f(@o = h) = 2f (ao) 


w : 
Ite) = ee he 
Give an example where this limit exists at x, but f” does not exist at 
Lo: 


2. Let f be a real-valued differentiable function on R. 
a. If there exists a constant b < 1 such that |f’(x)| < 6 for all z € R, 
prove that f has a fixed point in R. (See Exercise 13 of Section 4.3). 
b. Show that the function f(x) = «+(1+.e*)~' satisfies | f’(x)| <1 for 
all « € R but that f has no fixed point in R. 

3. A function f is convex (or concave up) on the interval (a, b) if for any 
x,y € (a,b), and0O<t<1, f(te+(1—t)y) <t f(x) + (1—-*) f(y). 
a. If f is convex on (a,b), prove that f is continuous on (a.b). 
b. If f is convex on (a,b), prove that f4(p) and f’(p) exist for every 
p € (a,b). Show by example that a convex function on (a,b) need not be 
differentiable on (a, b). 
c. Suppose f” (a) exists for all x € (a,b). Prove that f is convex on (a, b) 
if and only if f(x) > 0 for all x € (a,b). 

4. Suppose f is differentiable on [a,b] and that f’ is continuous on [a, J. 
Without using the mean value theorem, prove that 
nial Payee lany < er Se epee aa. 

5. (T.M. Flett) If f is differentiable on [a,b] and f’(a) = f’(b), prove that 
there exists ¢ € (a,b) such that 
fOQ-f@) _ » 
a = f'(¢)- 

6. Suppose f : (a,b) > R is differentiable at c € (a,b). If {sn} and {t,} are 
sequences in (a,b) with s, <c<t, and lim (tn — sn) = 0, prove that 


lim f (tn) a f(8n) -_ f'(o. 


n—-oo tn — Sn 
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Integration 


When Newton and Leibniz developed the calculus, both considered integration 
as the inverse operation of differentiation. For example, in the De analysi', 
Newton proved that the area under the curve y = ax™/” (m/n #4 —1) is given 
by 
anantl 
m+n 


by using his differential calculus to prove that if A(a) represents the area from 
0 to x then A’(x) = axz™/”. Even though Leibniz arrived at the concept of the 
integral by using sums to compute the area, integration itself was always the 
inverse operation of differentiation. Throughout the eighteenth century, the 
definite integral of a function f(x) on [a,b], denoted iC f(a)dx, was defined 
as F'(b) — F(a) where F' was any function whose derivative was f(x). This 
remained as the definition of the definite integral until the 1820’s. 

The modern approach to integration is again due to Cauchy, who was the 
first mathematician to construct a theory of integration based on approxi- 
mating the area under the curve. Euler had previously used sums of the form 


n 
So f(@e-1)(@k — Zp-1) to approximate the integral of a function f(z) in situ- 
k=1 


ations where the function F(a) could not be computed. Cauchy however used 
limits of such sums to develop a theory of integration that was independent of 
the differential calculus. One of the difficulties with Cauchy’s definition of the 
integral was that it was very restrictive; only functions that were continuous or 
continuous except at a finite number of points were proved to be integrable. 
However, one of the key achievements of Cauchy was that using his defini- 
tion he was able to prove the fundamental theorem of calculus; specifically, 
if f is continuous on [a, bj, then there exists a function F' on [a,b] such that 
F'(x) = f(x) for all x € [a, b]. 

The modern definition of integration was developed in 1853 by Georg 
Bernhard Riemann (1826-1866). Riemann was led to the development of the 
integral by trying to characterize which functions were integrable accord- 
ing to Cauchy’s definition. In the process, he modified Cauchy’s definition 
and developed the theory of integration which now bears his name. One of 
his achievements was that he was able to provide necessary and sufficient 


1 The Mathematical Works of Isaac Newton, edited by D. T. Whiteside, Johnson Reprint 
Corporation, New York, 1964. 
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conditions for a real-valued bounded function to be integrable. In Section 1, 
we develop the theory of the Riemann integral using the approach of Jean 
Gaston Darboux (1842-1917). In this section, we also include the statement 
of Lebesgue’s theorem which provides necessary and sufficient conditions that 
a bounded real-valued function defined on a closed and bounded interval be 
Riemann integrable. The equivalence of the Riemann and Darboux approach 
will be proved in Section 6.2. 

In Section 6.5 we will consider the more general Riemann-Stieltjes integral 
which will give meaning to the following types of integrals: 


[sear freyatel, orf 102) date), 


where a is a monotone increasing function on [a,b]. These types of integrals 
were developed by Thomas-Jean Stieltjes (1856-1894) and arise in many appli- 
cations in both mathematics and physics. The theory itself involves only minor 
modifications in the definition of the Riemann integral; the consequences how- 
ever are far reaching. The Riemann-Stieltjes integral permits the expression 
of many seemingly diverse results as a single formula. 


6.1 The Riemann Integral 


There are traditionally two approaches to the theory of the Riemann inte- 
gral; namely the original method of Riemann, and the method introduced by 
Darboux in 1875 using lower and upper sums. I have chosen the latter ap- 
proach to define the Riemann integral because of its easy adaptability to the 
Riemann-Stieltjes integral. We will however consider both methods and show 
that they are in fact equivalent. 


Upper and Lower Sums 

Let [a,b], a < b, be a given closed and bounded interval in R. By a partition 

P of [a,b] we mean a finite set of points P = {x9, 21, ...,%} such that 
A=% <4 <-++< tn =6b. 


There is no requirement that the points 7; be equally spaced. For each i = 
1, 2,...,n, set 
Ag; = 71> T-1; 
which is equal to the length of the interval [x;_, x]. 
Suppose f is a bounded real-valued function on [a,b]. Given a partition 

P = {x0,21,..-,2n} of [a,b], for each ¢ = 1,2,...,, let 

m, = inf{f(t): a1 <t<a;}, 

M; = sup{ f(t): aj-1 <t < a;}. 


Integration 225 


Since f is bounded, by the least upper bound property the quantities m,; 
and M; exist in R. If f is a continuous function on [a,b], then by Corollary 
4.2.9, for each i there exist points t;, 5; € [x;-1,2;] such that M; = f(t;) and 

The upper sum U(P, f) for the partition P and function f is defined by 


U(P, f)= S > M; Aaj. 
i=1 
Similarly, the lower sum L(P, f) is defined by 
L(P, f) = > mj Agi. 
i=1 


Since m; < M; for all 1 = 1,...,n, we always have 
LIP, f) SUP; f) 


for any partition P of [a,b]. The upper sum for a nonnegative continuous 
function f is illustrated in Figure 6.1. In this case, U(P, f) represents the 
circumscribed rectangular approximation to the area under the graph of f. 
Similarly the lower sum represents the inscribed rectangular approximation 
to the area under the graph of f. 


Xg =a Xy Xq X3 X4 x5 Xe xX7=b 


FIGURE 6.1 
Upper sum U(P, f) 
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Upper and Lower Integrals 
If the function f satisfies m < f(t) < M for all t € [a,b], then 

m(b—a) <L(P, f) <U(P, f) < M(b—-a), (1) 
for any partition P of [a,b]. To see that (1) holds, let P = {xo,...,a,} be any 
partition of [a,b]. Since M; < M for alli = 1,...,n, 


U(P, f) = 0 MAz; < SM (ai — t4-1) = M (b—-a). 
i=1 i=1 


Similarly £(P, f) > m(b—a). Thus the set {U/(P, f) : P is a partition of [a, b]} 
is bounded above and below, as is the set {L(P, f)}. 


DEFINITION 6.1.1 Let f be a bounded real-valued function on the closed 
and bounded interval [a,b]. The upper and lower integrals of f, denoted 


fie and Sef respectively, are defined by 


pb 

/ f =inf{U(P, f):P is a partition of [a, bl}, 
b 

i f =sup{L(P, f):P is a partition of {a, bj}. 


Since the sets {U(P, f)} and {L(P, f)} are nonempty and bounded, the 
lower and upper integrals of a bounded function f : [a,b] + R always exist. 


Our first goal is to prove that i f< ihe f for any bounded real-valued function 
f on [a,b]. To this end we make the following definition. 


DEFINITION 6.1.2 A partition P* of [a,b] is a refinement of P if 
PCP. 


A refinement of a given partition P is obtained by adding additional points 
to P. If P; and P2 are two partitions of [a,b], then P; U P2 is a refinement of 
both P; and Pp. 


LEMMA 6.1.3 If P* is a refinement of P, then 
L(P,f) < £(P*, f) <Uu(P", f) < UP, f). 


Proof. Suppose P = {20,21,...,2n} and P* = P U {a*}, where x* # «x; for 
any 7 = 0,1,...,n. Then there exists an index k such that rp_1 < 2* < Zp. 
Let 

Mj = sup{f(t):t € [ax-1,0°}}, 

Mz =sup{ f(t) :t € [2*,2a]} 
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Since f(t) < My, for all t © [ap_1,2%], we have that f(t) < My, for all t € 
[v~—-1, @*] and also for all ¢ € [z*,z,]. Thus both Mj and M7? are less than or 
equal to M;. Now 


k-1 
Uu(P*, f =>" MjAz; + Mj (a* — te—-1) + Mp (ax — 2*) 4S M;Aa;. 
j=l j=kt+1 
But 
Mj (a* =e Lp—1) + MP (re ar 2") < M,Acy. 
Therefore 


U(P*, f) <U(P, f). 


The proof for the lower sum is similar. If P* contains k more points than P, 
we need only repeat the above argument k times to obtain the result. 


THEOREM 6.1.4 Let f be a bounded real-valued function on [a,b]. Then 


eae 


Proof. Given any two partitions P, Q of [a,b], 
L(P, f) < LIP UQ, f) <U(PUQ, f) <U(Q, f). 
Thus L(P, f) <U(Q, f) for any partitions P, Q. Hence 


b 
[ faswer.f) suas) 


for any partition Q. Taking the infimum over Q gives the result. 


The Riemann Integral 
If f : [a,b] > R is bounded, then the lower and upper integrals of f on [a,)] 


always exist and satisfy ic fxs Hi f. As we will shortly see, there is a large 
family of functions for which equality holds; such functions are said to be 
integrable. 


DEFINITION 6.1.5 Let f be a bounded real-valued function on the closed 


and bounded interval [a, 6]. If 
b pb 
prefs. 


then f is said to be Riemann integrable or integrable on [a,b]. The com- 
mon value, denoted 
b 
eee 
a 
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is called the Riemann integral or integral of f over [a,b]. We denote by 
Ra, b] the set of Riemann integrable functions on [a,b]. In addition, if 


f € Rla,b], we define 
ie =--f 


Alternate notation that is sometimes used to denote the Riemann integral 


of f is 
b 
if f(x) da. 


In the above, the variable x could just as easily have been ¢t, or any other 
convenient letter. 
If f : [a,b] > R satisfies m < f(t) < M for all t € [a,b], then by inequality 


(1), 


mo-os [rs freuo-a 


If in addition f € Ra, b], then 
b 
m(b—a) < | f<M(b-a). 


In particular, if f(a) > 0 for all x € [a,b], then ih f >0. If f € Ra, b] is non- 
negative, then the quantity i f represents the area of the region bounded 
above by the graph y = f(x), below by the z-axis, and the lines x = a and 
r=b. 


EXAMPLES 6.1.6 (a) The following function, attributed to Dirichlet, is 
the canonical example of a function that is not Riemann integrable on a closed 
interval. Let f be defined by 


2. ayy ee), 
no={f a. 


Suppose a < b. If P = {xo,...,Xn} is any partition of [a,b], then m; = 0 and 
M; = 1 for alli = 1,...,n. Thus 


L(P, f) =0 and Uu(P, f) = (b-a) 


for any partition P of [a, b]. Therefore 


[5-0 and [f= 0-0. 


and as a consequence f is not Riemann integrable on [a, 6]. 
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(b) Let f : [0,1] — R be defined by 


’ 


pan 

oy 

II 
SS 
id 
a) 
IA IA 


x 
x 


IA A 
me Nie 


In this example, we prove that f is integrable on [0,1] with ie f= 5: Let 
P = {x0,1,...,%n} be a partition of [0,1], and let k € {1,...,n — 1} be such 
that rp_1 < $ < xz (See Figure 6.2). If m; and M; denote the infimum and 
supremum of f on [x;-1, 7;] respectively, then 


wee 0, i=1,...,k, ua ie 0, i=1,...,k-1, 
1 t=k+1,...,n, = 


x 
1 —_———_____-@ 
TT eS - - t =f 
xXp=O0 XE-1 1 Xf, X,=1 


FIGURE 6.2 
The function of Example 6.1.6(b) 


Thus 


LIP, f)= >> Ag, =(1—ayx), and 
i=k+1 


U(P, f) = _ Aaj = (1 — 2-1) 
ix=k 


Since 1 — a, < 5 < 1—ap-1, L(P,f) < 4 < U(P,f) for all partitions 
P of [0,1]. Thus ie mg ioe Hence if f is integrable on [0,1], then 
: JO. 

J f =1/2. We conclude by proving that f is indeed integrable on [0, 1]. Since 
0 

1 — xp—-1 = (1 — 2x) + (te — Le-1), we have 


U(P, f) =L(P, f) + (ek — Le-1). 
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Let € > 0 be arbitrary. If P is any partition of [0,1] with Az; < e€ for all i, 
then U(P, f) < L(P, f) +e. Thus 


se 
; f =infl(Q, f) <U(P.f) 
0 


1 
LPH) +e <supl(a,f)+es f fe, 
Q YO 


where the infimum and supremum are taken over all partitions Q of [0,1]. 


Since € > 0 was arbitrary, we have es f= in f. Therefore f is integrable on 
: J0. 

(0, 1] with f f = 1/2. 
0 


(c) We now provide another example to illustrate how tedious even a trivial 
integral can be if one relies only on the definition of the integral. Luckily, the 
fundamental theorem of calculus (Theorem 6.3.2) will allow us to avoid such 
tedious computations. Let f(#) = x, a € [a,b], where for the purpose of 
illustration we take a > 0 (Figure 6.3). Interpreting the integral as the area 
under the curve, we intuitively see that 


b 
| nile 5b a)(b+a) = 50 ~ a). 


This is obtained from the formula for the area of a parallelogram. Let P = 
{£o, U1, ...,%n} be any partition of [a,b]. Since f(x) = x is increasing on [a, b], 


m= f(ai-1) = Xj-1; and M; = f (xi) = Tj. 


FIGURE 6.3 
Example 6.1.6(c) 


Therefore 


L(P,f) = yo aeiAg; and Uu(P, f) — rea: 
i=1 i=1 
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For each index 7, 


1 
MAS 3 (aj-1 + Bi) < a. 


If we multiply this by Ax; = 2; — x;_, and sum from i = 1 to n, we obtain 
a 
L(P, f) <2 9 ee) SUP, 7). 


But 


Finally, if we take the supremum and infimum over all partitions P of [a,b], 


we have — 
b l b 
[eds 5 -a)< [ede 


This in itself does not prove that 


M 1 
[ vde=5(P-0). 


To prove that f is integrable on [a,b], we note that for any partition P of 
[a, 2, 


n 


“pb b 
0< f xde— f cde <UP,f)-£(P,f) = (ei —m)An, 


i=l 


< ( max Asi) (b—a). 
l<i<n 


Let € > 0 be given. If we choose a partition P such that Az; < €/(b—a+1) for 
all 7, then fre dx — fre dx < ¢. Since this holds for every € > 0, we conclude 


that Sux dz = fox dx. Thus f(x) = «x is Riemann integrable on [a,b] with 


fede = 


4 (0? — a2). 


(d) Consider ne function f(x) = x”, x € [0,1]. For n € N, let P, be 
the partition {0, + ., L}. Since f is increasing on [0,1], its infimum and 


1=,2,.. 


supremum on each oe [+ +] are attained at the left and right endpoint 
respectively, with m; = (¢ — 1) 2/2 and M; = ein. Since Ax; = = 4 for all i, 
1 
£(Pn, f) = —3[V° +2? 4.---4+(n—1)?], and 


U(Pa f) = +2? + +n? 
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Using the identity 1? + 2? +--+. +m? = ém(m + 1)(2m + 1) (Exercise 1(c), 
Section 1.3), we have 


L(Pn, f) = : (1 =| (2 -) and P.. A= ; (1+ =| (2+=). 


Thus sup £(P,,, f) = 1/3 and infU(P,, f) = 1/3. Since the collection {P, : 
n € N} is a subset of the set of all partitions of [0, 1], 


1 
5 =supL(Pn, f) < supL(P, f) = i: xdx, and 
n P Jo_ 


pl 
5 =infU(Pn, f) > infU(P, f) -| z'dz. 
n 0 


1 
Therefore f(z) = x? is integrable on [0,1] with f 2? dx = 1/3. 
0 


Riemannn’s Criterion for Integrability 


The following theorem, the original version of which is due to Riemann, pro- 
vides necessary and sufficient conditions for the existence of the Riemann 
integral. 


THEOREM 6.1.7 A bounded real-valued function f is Riemann integrable 
on [a,b] if and only if for every « > 0, there exists a partition P of [a,b] such 
that 


Furthermore, if P is a partition of [a,b] for which (2) holds, then the inequality 
also holds for all refinements of P. 


Proof. Suppose (2) holds for a given e > 0. Then 
pb b 
o<fr-f rsur.p-cP.f<e 
Thus f is integrable on {a, d]. 


Conversely, suppose f is integrable on [a, b]. Let « > 0 be given. Then there 
exist partitions P, and P2 of [a,b] such that 


b b 
uPat-fr<$ amd f f-cmn<§. 
Let P = P; U Pz. Then 


b 
U(P.F) <UPaf)< [ fH5<LPLf)+es cP. A +e 
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Therefore, U(P, f) — L(P, f) < €, which proves (2). If Q is any refinement of 
P, then by Lemma 6.1.3 


0<U(Q, f) — L(Q, f) SUP To EP) <€. 


Thus (2) is also valid for any refinement of Q of P. 


Integrability of Continuous and Monotone Functions 


As an application of the previous theorem we prove that every continuous real- 
valued function and every monotone function on [a,b] is Riemann integrable 
on [a,b]. As we will see, both of these results will also follow from Lebesgue’s 
theorem (Theorem 6.1.13). 


THEOREM 6.1.8 Let f be a real-valued function on [a, b]. 
(a) If f is continuous on [a,b], then f is Riemann integrable on |a, b}. 


(b) If f is monotone on [a,b], then f is Riemann integrable on [a,b]. 


Proof. (a) Let € > 0 be given. Choose 7 > 0 such that (b — a)n < ¢. Since f 
is continuous on [a,b], by Theorem 4.3.4 f is uniformly continuous on [a, 6]. 
Thus there exists a 6 > 0 such that 


If(z) -— FO <n (3) 


for all x, t € [a,b] with |x —t| < 6. Choose a partition P of [a,b] such that 
Aa; < 6 for all i = 1,2,...,n. Then by (3), 


M,-m <7 


for all i = 1,2,...,n. Therefore 


n 


Uu(P, f) -L(P, f) = SoM —m)Ax; <7 Sy Ag; =n(b-a) <e. 
i=1 i=1 
Thus by Theorem 6.1.7 f is integrable on [a, }]. 

(b) Suppose f is monotone increasing on [a, b]. For n € N, set h = (b—a)/n. 
Also for i = 0,1,...,n, set 7; =a+tih. Then P = {20,21,...,%n} is a partition 
of [a,b] which satisfies Ax; = h for all i = 1,...,n. Since f is monotone 
increasing on [a,b], m; = f(a:-1) and M; = f(ax;). Therefore, 


n 


U(P, f)— L(P, f) = >_[fes) — Fea)Aa 


i=1 


—h > f(a) — f(ai-1)] = 
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Given € > 0, choose n € N such that 


For this n and corresponding partition P, U(P, f) — L(P, f) < «. Thus f is 
integrable on [a, 6]. 


The Composition Theorem 


We next prove that the composition yo f of a continuous function y with a 
Riemann integrable function f is again Riemann integrable. As an application 
of Lebesgue’s theorem we will present a much shorter proof of this result later 
in the section. 


THEOREM 6.1.9 Let f be a bounded Riemann integrable function on [a, b 
with Range f Cc [c,d]. If y is continuous on [c,d], then yo f is Riemann 
integrable on |a, b]. 


Proof. Since y is continuous on the closed and bounded interval [c,d], y is 
bounded and uniformly continuous on [c,d]. Let K = sup{|p(t)| : t € [c,d]}, 
and let « > 0 be given. Set <’ = €/(b—a+2K). 

Since vy is uniformly continuous on [c,d], there exists 6,0 < 6 < é, such 
that 


le(s) — (| < é (4) 


for all s,t € [c,d] with |s—t| < 6. Furthermore, since f € R[a, b], by Theorem 
6.1.7 there exists a partition P = {xo0,21,...,2n} of [a,b] such that 


To complete the proof we will show that 


By Theorem 6.1.7 it then follows that yo f € RIa, b. 
For each k = 1, 2,...,n, let mz, and M;, denote the infimum and supremum 
of f on [x,_-1, 2%]. Also, set 


my, = inf{p(f(t)):t € [ve-1,vK]} and My = supty(f(t)) +t € [ax—1, re] f- 

We partition the set {1,2,...,n} into disjoint sets A and B as follows: 
A={k:M,—mp <6} and B={k:M,—mg, > 6}. 

Since | f(t) — f(s)| < My, — mg for all s,t € [v,_1, vg], if & € A, then by (4) 


le(F(t)) — o(f(s))1 < € 
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for all s,t € [v,_-1, xx]. But 


M, — mj, = supty(f(t)) — e(f(s)) + 8,8 € [we—-1, va]. 


Therefore M7 — mj < ¢' for all k € A. On the other hand, if k € B, then 
Mz — mz < 2K. Thus 


U(P, yo f)-L(P, po f) = S_ (Mg — mp) Are + S > (Mf - mj) Ace 


keA keB 
<eé So Aa, +2K $7 Acy 
keA keB 


<é(b—a)+2K S- Ax. 
keB 


But for k € B, 6 < My — mg. Therefore, 
1 1 
kEB keB 


and hence by the above 


U(P,yof)-LIP, pof)<e(b—a)+2Ke' =e. 


This establishes (5), and thus yo f € R{a, }]. 

As a consequence of the previous theorem, if f is Riemann integrable on 
[a,b], then so are the functions |f| and f?. For emphasis we state this as a 
corollary. 


COROLLARY 6.1.10 Jf f € R[a,b], then |f| and f? are Riemann inte- 
grable on |a, b]. 


A natural question to ask is whether the composition of two Riemann 
integrable functions is Riemann integrable. In Example 6.1.14(b) we will show 
that the answer is an emphatic no! 


Lebesgue’s Theorem 


In Theorem 6.1.8(a) we proved that every continuous function on [a,b] is 
Riemann integrable on [a, b]. By Exercise 16, this is also true for every bounded 
function on [a, b] that is continuous except at a finite number of points. On the 
other hand, as a consequence of Theorem 6.1.8(b), every monotone function on 
[a, 6] is Riemann integrable. Hence for example, if {r,}°2 is an enumeration 
of the rational numbers in [0,1] and c, > 0 are such that S*c, converges, 
then by Theorem 4.4.10 


f (2) = Sen (@ — Tn) 
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is monotone increasing on [0,1], and thus is Riemann integrable on (0, 1]. B 
Theorem 4.4.10, the function f is continuous at every irrational number and 
discontinuous at every rational number in [0,1]. 

We now state the beautiful result of Lebesgue which provides necessary and 
sufficient conditions that a bounded real-valued function on [a,b] be Riemann 
integrable. To properly state Lebesgue’s result we need to introduce the idea 
of a set of measure zero. The concept of measure of a set will be treated in 
detail in Chapter 10. The basic idea is that the measure of an interval is its 
length. This is then used to define what we mean by measurable set and the 
measure of a measurable set. At this point we only need to know what it 
means for a set to have measure zero. 


DEFINITION 6.1.11 A subset E of R has measure zero if given any 
€ > 0, there exists a finite or countable collection {In}nea of open intervals 


such that 
ECUm and Sled 
neA neA 


where €(I,,) denotes the length of the interval I. 


EXAMPLES 6.1.12 (a) Every finite set E has measure zero. Suppose E = 
{x1,...,2n} is a finite subset of R. For each n = 1,2,...,N, as in Figure 6.4 


let P Z 
In = ( mM Dvapren =~) : 
Bn on og 
Iz Ig 
eas is e<Oe5 on 
x3 XG 
FIGURE 6.4 
Example 6.1.12(a) 
Then 
N N 
Bo Ia, and Sf) 6 
= n=1 


Therefore & has measure zero. 


(b) Every countable subset of R has measure zero. Suppose EF = {x,}°2, 
is a countable subset of R. Let € > 0 be given. For each n € N, let 


€ € 
inte angi tn | sai) - 


Since z, € I, for alln, EC U In. Thus since ¢(I;,) = €/2”, 


n=1 
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As an example, the set Q of rational numbers has measure zero. 


(c) As we shall see in the exercises of Section 10.2, the Cantor set P in 
(0, 1], which is uncountable, also has measure zero. 


We now state the following theorem of Henri Lebesgue, the proof of which 
will be given in Section 6.7. This result appeared in 1902 and provides the most 
succinct form of necessary and sufficient conditions for Riemann integrability. 


THEOREM 6.1.13 (Lebesgue) A bounded real-valued function f on [a,b] 
is Riemann integrable if and only if the set of discontinuities of f has measure 
zero. 


Remark. If f is continuous on [a,b], then clearly f satisfies the hypothesis 
of Theorem 6.1.13 and thus is Riemann integrable. If f is a bounded function 
which is continuous except at a finite number of points, then by Example 
6.1.12(a) the set of discontinuities of f has measure zero. Hence f € R{a, }]. 
If f is monotone on [a,b], then by Corollary 4.4.8, the set of discontinuities 
of f is at most countable, and thus by Example 6.1.12(b), has measure zero. 
Hence again f € R{a, b]. 

As an application of Lebesgue’s theorem we give the following short proof 
of Theorem 6.1.9. 


Proof of Theorem 6.1.9 using Lebesgue’s Theorem. As in Theorem 
6.1.9, suppose f € Ra, b] with Range f C [c,d], and suppose y: [c,d] — R is 
continuous. Let 


E = {x € [a,b] : f is not continuous at x} and 
F = {x € [a,b]: yo f is not continuous at x}. 
By Theorem 4.2.4, F Cc FE. Since f is Riemann integrable on [a,b], the set E 


has measure zero, and as a consequence so does the set F’. Therefore yo f € 
Ra, b]. 


EXAMPLES 6.1.14 (a) As in Example 4.2.2(g), let f be defined on (0, 1] 
by 


— 


x =0, 


Sb 
— 
8 
~ 
I 
= 


if x is irrational, 


JR 


i. tees 
: if 2 = @ in lowest terms, x # 0. 


3 
3 


Since f is continuous except at the rational numbers, which have measure 
zero, f is Riemann integrable on [0,1]. Furthermore, since £(P, f) = 0 for all 
partitions P of [0, 1], 


[ te)ar=0. 
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(b) Let f be the Riemann integrable function on [0,1] given in (a), and 
let g : [0,1] + R be defined by 


0, x=0, 
g(a) = im x € (0, 1]. 


Since g is continuous except at 0, g € R[0, 1]. But for x € [0, 1], 


1, if x is rational, 
(90 f)(x) = 


0, if x is irrational. 


By Example 6.1.6(a), go f ¢ R[0, 1]. 


Exercises 6.1 


1. Let f(x) =1—2?, « € [-1,2]. Find L(P, f) and U(P, f) for each of the 
following partitions of [—1, 2]. 


*a.P ={-1,0,1,2} b. P= {-1,-$,0, 5,13, 2} 
2. Show that each of the following functions is Riemann integrable on [0, 2] 
and use the definition to find ie f. 


1 Weeed i Det < 3) 
= x 

*a. f(x) = : = ; b. f(x) = ¢ —3, 1 pc 3. 
f(o) fe io pea<t 


3. Show that each of the following functions is Riemann integrable on [a, dJ, 
and find [” f. 


0, ax<nu<c 
*a. f(x) =c, (ec aconstant) b. f(z)=45, wee, 
1, c<a<b 


4. Use one of the methods of Examples 6.1.6 to find ie f for each of the 
following functions f. In the following, [z] denotes the greatest integer 


function. 
*a. f(x) = [Ba] b. f(x) = 2[2a] 
*c. f(x) =3a+1 d. f(x) =1-2° 


5. Prove that f f =0 for any real-valued function f on [a, a]. 


b b 
6. *If f, g € Ria, 6] with f(x) < g(x) for all x € [a,b], prove that f f < fg. 
7. a. Suppose f is continuous on [a,b] with f(x) > 0 for all x € [a, }]. If 
b 
{ f =0, prove that f(x) =0 for all x € [a, bj. 


b. Show by example that the conclusion may be false if f is not contin- 
uous. 
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8. 


10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


*a. Let f : [0,1] — R be defined by 
0, xrEQ, 
f(x) = 
tr, rE€Q 
Compute Ae and hee Is f integrable on [0, 1]. 
Suppose f is a nonnegative Riemann integrable function on [a, b] satisfy- 


b 
ing f(r) =0 for all r € QN [a,b]. Prove that f f =0. 
*Use the method of Example 6.1.6(c) to show that 

b 
[ vac= 50-2") (0<a<d). 


Suppose f is monotone increasing on {a, b]. For n € N, set h = (b—a)/n. 
Let Pn = {x0,%1,...,%n} where for each k = 0,...,n, ce =atkh. 
a. Prove that 

"ao (=a) 
0<u(Pr,f)- f ts 


[f(o) — f(a]. 


b 
b. Prove that f f = lim U(Pn, f). 
a n—-oo 


Use the previous exercise to evaluate the following integrals. 
b 


1 1 1 
*a, / a dx. b. / (3a — 2) dx. *e. / x da d. [ea 
0 -2 0 


a 


*Let f be a bounded function on [a,b]. Suppose there exists a sequence 
{Pn} of partitions of [a,b] such that 


lim L(Pn,f) = lim U(Pn, f)=L, LER. 
n—-oo TCO 
b 
Prove that f is Riemann integrable on [a, 6] with f f=L. 


*a. If f © Ra, b], prove directly (without using Theorems 6.1.9 or 6.1.13) 
that |f| € R[a, b]. 


b. If |f| € Ra, bl, is f € Ria, b]? 

b b 

J i <flfl- 

*a. If f © Ra, b], prove directly that f? € Ria, b]. 


b. Give an example of a bounded function f on [a,b] for which f? € 
Ria, b], but f ¢ Ria, b]. 


*Suppose f is a bounded real-valued function on [a,b] that has only a 
finite number of discontinuities. Prove directly that f is Riemann inte- 
grable on {a, 6}. 


c. If f € Ria, b], prove that 


a. If E has measure zero, prove that every subset of EF has measure zero. 


b. If £1, Eo have measure zero, prove that Ei; U E2 has measure zero. 
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co 

c. If each En, n = 1,2,..., has measure zero, prove that ) En has mea- 
n=1 

sure zero. 


18. Use Theorem 6.1.13 to prove that if f, g € Ra, b], then f + g € Ra, dj. 


19. Prove directly that the function f of Example 6.1.14(a) is Riemann inte- 
grable on {a, 6}. 


20. Let f : [a,b] — R be continuous. Suppose that for every Riemann inte- 
grable function g : [a,b] > R the product fg is Riemann integrable and 
ie fg =0. Prove that f(x) = 0 for all x € [a, BJ. 


21. a. Let {In} be a finite or countable collection of disjoint open intervals 
in [a,b], and let U = UIn. Define f on [a,b] by f(x) = 1 if « € U, 
and 0 elsewhere. Prove that f is Riemann integrable on [a,b] and that 
b 
J f= Ch). 

b. Let P denote the Cantor ternary set in [0,1] and let f be defined on 
[0,1] by f(a) = 0 if  € P, and f(#) = 1 elsewhere. Prove that f is 


1 
Riemann integrable on [0,1] and that f f = 1. 
0 


6.2 Properties of the Riemann Integral 


In this section, we derive some basic properties of the Riemann integral. As 
in the previous section, [a,b], a < b, will be a closed and bounded interval in 
R, and R][a, b] denotes the set of Riemann integrable functions on [a, 6]. 


THEOREM 6.2.1 Let f, g € R[a, b]. Then 


(a) f+ gE Rla,b with Pra = for fis 
b 


b 
(b) cf € Ria, b] for allc Ee R with | aa) f, and 
(c) fg € Ria, d]. 


Proof. (a) The integrability of f +g is actually a consequence of Theorem 
6.1.13. However, in establishing the formula for the integral of (f +g), we will 
also obtain the integrability of f + g as a consequence. Let P = {29,...,2n} 
be a partition on [a,b]. For each i = 1,...,n let 


Mi(f) = sup{ f(t) : t € [zi-1, zi]}, 
Mi(g) = sup{g(t) : t € [xi-1, x] }. 


Then f(t) + g(t) < Mi(f) + Mi(g) for all t € [a;_-1,x;] and thus 


sup{ f(t) + g(t) : t € [wi-1, vi]} < Mi(f) + Mi(g). 
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Therefore, for all partitions P of [a, }], 
UP, f +9) <U(P, f) +U(P, 9). 


Let € > 0 be given. Since f, g € Ra, 6], there exist partitions Py and P, 
of [a,b] such that 


e b 
u(P;.f) < f f+de and U(Ps,9) < f g+ he. 


Let OQ = Py UP,. Since Q is a refinement of both Py and Py, 


U(Q, f +g) <U(Py, f) +U(P n< [s+ fore 


Nica 


Since the above holds for all € > 0, 


foros fs f's 


A similar argument proves that 


furaz firs fo 


Thus the lower integral of (f + g) is equal to the upper integral of (f + 9), 
and as a consequence (f + g) € R{a, 6] with 


furo=fs+ fs 


(b) The proof of (b) is left as an exercise (Exercise 1). 


Therefore 


(c) To prove (c), we first note that 


fo= 7 (tf +9)? - (f —g)"]- 


By (a) the functions (f + g) and (f — g) are integrable on [a,b], and by 
Corollary 6.1.10, (f +g)? and G— g)” are integrable. Hence by (a) and (b), 
fg is integrable on {a, }]. 


THEOREM 6.2.2 If f € R{a,b], then |f| € Ria, b] with 


[s < fit. 


242 Introduction to Real Analysis 


Proof. Since f € R[a,b], by Corollary 6.1.10 |f| € Ria, db]. Let c = +1 be 
such that If fl = cf? f. Since cf(x) < |f(x)| for all x € [a,b], U(P, cf) < 
U(P,|f|) for any partition P of [a,b]. Therefore, since both cf and |f| are 
integrable, iis cf < He | f|. Combining the above we have 


[ane fre fers fin 


THEOREM 6.2.3 Let f be a bounded real-valued function on [a,b], and 
supposea<c<b. Then f € R{a, b] if and only if f € Ria,c] and f € Ric, b}. 


If this is the case, then 
b c b 
frofrefes (6) 


Proof. Let c € R satisfy a < c < b. We first prove that if f is a bounded 
real-valued function on [a, b], then 


shi, ae ae 
fsafrefe (7) 
Suppose P; and P2 are partitions of [a,c] and [c,}] respectively. Then P = 
P; UPz2 is a partition of [a,b] with c € P. Conversely, if P is any partition of 


[a,b] with c € P, then P = P; U Pz where P, and P2 are partitions of [a,c] 
and [c, b], respectively. For such a partition P, 


=e! A SRE 
UP. f)=UPL f)+UPa fe f f+ fF. 


If Q is any partition of [a, b], then P = QU{c} is a refinement of Q containing 
c. Therefore 


wanzur.n> [r+ fr 


Taking the infimum over all partitions Q of [a, b] gives 
7s as 
praferfet 


To prove the reverse inequality, let « > 0 be given. Then there exist parti- 
tions P; and P2 of [a,c] and [c, b] respectively such that 


c b 


uPi.f<f t+5 and U(Paf)< f £+5. 


a c 
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Let P = P, U Pe. Then 


ab =e. —COtSCO 
[ fsu@nquen+uPat< fat fire 


Since € > 0 was arbitrary, 

pb He pb 

frsft+fs 
which when combined with the previous inequality proves (7). A similar ar- 
gument also proves 

b c b 

psafrr fe (8) 

If f is integrable on [a,c] and [c, b], then by (7) and (8) 
c b b pb c b 
fs+tfasfasfr-fsrfs 

Therefore f € R[a,b] and identity (6) holds. Conversely, if f € 7[a, 6], then 


by (7) and (8), an 
[se fee frp 


Since the lower integral of f is always less than or equal to the upper integral 
of f, the above holds if and only if 


feefs and [r= [s 


Hence f € Ria,c] and f € Ric, b]. 


Riemann’s Definition of the Integral 
We close this section by comparing the approach of Darboux with the original 


method of Riemann. 


DEFINITION 6.2.4 Let f be a bounded real-valued function on [a,b] and 
let P = {x9,21,...,Un} be a partition of [a,b]. For each i = 1,2,...,n, choose 
t; € [w;-1, xi]. The sum 


SPA) =D fltiAci 


is called a Riemann sum of f with respect to the partition P and the points 


{ti}. 
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FIGURE 6.5 
A Riemann sum S(P, f) of f 


In the Riemann approach to integration, one defines the integral of a 
bounded real-valued function f as the limit of the Riemann sums of f. Since 
S(P, f) depends not only on the partition P = {2,71,...,%n} but also on the 
points t; € [x;-1, 2;], we first need to clarify what we mean by the limit of the 
Riemann sums S(P, f). For a partition P = {xo,21,...,2n} of [a,b], set 


||P|| = max{Ax; :7=1,2,...,n}. 
The quantity ||P|| is called the norm or the mesh of the partition P. 
DEFINITION 6.2.5 Let f be a bounded real-valued function on [a,b]. Then 


lim S(P,f)= I 
|P||+0 Ph) 


if given € > 0, there exists a 6 > 0 such that 


<e€ (9) 


i=l 


for all partitions P of [a,b] with ||P|| < 6, and all choices of ty € [aj-1, vi]. 


THEOREM 6.2.6 Let f be a bounded real-valued function on |a, b]. If 


lim S(P,f)= I, 
|P||+0 Pf) 
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then f € Ra, b] and ie = I. Conversely, if f © Ria, b], then ne oe S(P, f) 


exists and 
lin S(P,f) -[ de 
\|P || +0 
Proof. Suppose iaeo f) =I. Let € > 0 be given, and let 6 > 0 be such 
> 


that (9) holds for all partitions P = {%9,21,..., Un} of [a, 6] with ||P|| < 6, and 
all t; € [x;-1,2;]. By the definition of M;, for each i = 1,...,n, there exists 
G E [vi-1, xi] such that f(G) > M; —«. Thus 


i=1 
<S°f(G) Agi te S> Ag; 
i=1 i=1 


<I+e+e[b—a]=I+e[1+b-al. 
Similarly L(P, f,a) > I —¢[1+6-—a]. Therefore, 
UP, f) —L(P, f) < 2ef1+5—al. 


b 
Thus as a consequence of Theorem 6.1.7, f € R[a,b] with f f =I. 


Conversely, suppose f € Ra, b]. Let M > 0 be such that |f(x)| < M for 
all x € [a,b]. Let « > 0 be given. Since f € Ra, b], by Theorem 6.1.7 there 
exists a partition Q of [a,b] such that 


b b 
[ fresclansuan< | fte. 


Suppose Q = {2o,...,un}. Let 6 = e€/NM, and let P = {yo,..., yn} be any 
partition of [a,b] with ||P|| < 6. As in the definition of the integral, let 


M; =sup{f(x): a € [wi-1,aJ}, i=1,...,N. 


Consider any interval [y,-1, yx], & = 1,...,n. This interval may or may not 
contain points x; € Q. Since Q contains N +1 points, there are at most N—1 
intervals [y,—1, yz] which contain an x; € Q, i # 0, N. Suppose as in Figure 6.6 
{25,..-,j;4m} C [ye—1, Yel. If 2} A yR-1, set Mi = sup{ f(x) : x € [yx_1, 25]}- 
Similarly, if 2j4m #4 yr, set M? = sup{f(z) : x € [xjim, yelf- 

Let te € [yx—1, yz] be arbitrary. Since | f(t) — f(s)| < 2M for all t,s € 
[ye—1, Yk]; 


f(te) <2M+ Mj4s, s=1,...,m, and 
f(t.) <2M+Mi, i=1,2. 
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Ve=1 Vk 


KM Ny Xpam 


FIGURE 6.6 
Partition of the interval [y,—1, yx] 


Therefore 


m 


F (te) Aue = f (te) (ej — ye-1) + D5 f (te) Aajss + f (th) (Ye — Cj4m) 
s=1 
< 2M Ayp + My (xj — ye-1) +), MjpoAaj+s + Me (Ye — 2j+m) 
s=l1 


< 2M6+U(Px, f), 


where Py = {Y—1,2j,---,Lj4+m, ye} is a partition of [yx—1, yx]. If the interval 
[Ye—1,Yz] contains no x; € QO, i # 0,N, we simply let Py = {yp_1, yz}. Let 
P' = UP. Then P’ is a partition of [a,b] that is also a refinement of Q. Since 
at most N — 1 intervals [y,x-1, ye] contain a point of Q other than xo and zy, 


S(P,f) = S~ f(te) Aye < 2M(N —1)6+ S"U(Pr, f) 


k 


n n 


1 k=1 


b 
< 26+ U(P’, f) < 26 +U(Q, f) < se+ | f. 


A similar argument proves that 


b 
sp.t)> | f —3e. 


Therefore, 
b 


< 3e. 


sp.f)- | f 


Since this holds for any partition P = {yo,..., Yn} of [a,b] with ||P|| < 6 and 
any choice of ty € [yp—1, yx], k =1,...,7, 


lim S(P, f) = i f. 


|P||o 
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EXAMPLE 6.2.7 In this example, we will use the method of Riemann sums 


b 
to evaluate f xdx. Since f(x) = is Riemann integrable on [a, 6], 


b 
[vac = tim S(P, f). 


P\|0 


Since the limit exists for any t; € [a;-1,2i], we can take t; = (a;_1 + x;)/2. 
With this choice of t;, 


n n 


SOP, A) = 5 Yileinn + i)leia — 04) = 5 Dah — 0?) = 5 (P -0), 


i=1 i=l 


which proves the result. 


Exercises 6.2 


1. Prove Theorem 6.2.1(b). 


b 
2. *a. Use the method of Riemann sums to evaluate f x dz. 
a 


b 
b. Use the method of Riemann sums to evaluate [a"dx,n EN, n > 3. 
a 


3. *a. Let f be a real-valued function on [a,b] such that f(x) = 0 for all 
b 
&#C1,...,Cn. Prove that f € Ria, b| with f f =0. 
*b. Let f, g € R[a, b] be such that f(a) = g(x) for all but a finite number 
b b 
of points in [a,b]. Prove that f f = fg. 


c. Is the result of (a) still true if f(z) = 0 for all but countably many 
points in [a, b]? 


4. Let f € R[-a,a], a > 0. Prove each of the following: 


a. If f is even (i.e. f(—x) = f(x) for all x € [—a,a]), then i fa2 Teh 
—a 0 


b. If f is odd (ie. f(—x) = —f(x) for all x € [—a,a]), then i f=0. 


5. *Let f be a bounded real-valued function on [a, }] such that fi € R{c, b] 


for every c, a<c< b. Prove that f € R{a, b] with f f= lim, Ir. 


coat Cc 


6. Let f be continuous on [0,1]. Prove that 


tins DFG )=f seve 
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7. Use the previous exercise to evaluate each of the following limits. (You 
may use any applicable methods from calculus to evaluate the definite 
integrals. ) 


. Ll 2 : k . n 
* oe. roe, 1 Se 2 
a. Jim 73 2. k b. im > 724 c. jim > / 724 


d. lim a So kV k? +n? 
noo 1 ay 
8. *As in Example 4.4.11(a), let f be a monotone function on [0, 1] defined 


by 
fle) = 3 a le— 20), 


=1 


1 
where tn = n/(n +1), n EN. Find f f(x)dx. (Leave your answer in the 
0 


form of an infinite series.) 


9. Suppose f € Ria,b] and c € R. Define f. on [a — c,b— ¢] by f-(x) = 
f(a+c). Prove that fe € R[a — c,b— c] with 


i fe(a)dx = ie f(a)dz. 


10. Let f, g, h be bounded real-valued functions on [a,b] satisfying f(x) < 
b b 
g(x) < h(x) for all x € [a,b]. If f, h € Ria, b) with f f = fh =I, prove 


b 
that g € Ra, b] with fg =I. 


6.3 Fundamental Theorem of Calculus 


In this section, we will prove two well known and very important results. 
Collectively they are commonly referred to as the fundamental theorem of 
calculus. To Newton and Leibniz, integration was the inverse operation of 
differentiation. In Leibniz’s notation this result would simply be expressed as 
J f'(x)da = f(a), where here the symbol [ (denoting sum) was Leibniz’s 
notation for the integral. This notation is still used in most calculus texts 
to denote the antiderivative of a function. Since the modern definition of the 
integral is based on either Riemann or Darboux sums, we now need to prove 
that integration is indeed the inverse operation of differentiation. Both versions 
of the fundamental theorem of calculus presented here are essentially due to 
Cauchy who proved the results for continuous functions. 

As was illustrated in Examples 6.1.6 and 6.2.7, the computation of the 
integral of a function, using either Darboux’s or Riemann’s definition, can be 
extremely tedious. For nontrivial functions these computations are in most 
instances impossible. The first version of the fundamental theorem of calculus 
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provides a major tool for the evaluation of Riemann integrals. We begin with 
the following definition. 


DEFINITION 6.3.1 Let f be a real-valued function on an interval I. A 
function F on I is called an antiderivative of f on I if F'(x) = f(x) for all 
xel. 


Remark. An antiderivative, if it exists is not unique. If F' is an antiderivative 
of f, then so is fF +C for any constant C’. Conversely, if F and G are an- 
tiderivatives of f, then F’(x) — G’(x) = 0 for all x € [a,b]. Thus by Theorem 
5.2.9, G(x) = F(x) + C for some constant C. 


THEOREM 6.3.2 (Fundamental Theorem of Calculus) Jf f € R{a, }] 
and if F is an antiderivative of f on [a,b], then 


b 
/ f(x) dx = F(b) — F(a).? 


Proof. Let P = {%o0,21,...,2n} be any partition of {a, b]. If F is an antideriva- 
tive of f, then by the mean value theorem, for each i = 1,...,n, there exists 
ti € (@i-1, 2) such that 


Therefore, 
Slt t)Aa, = YF) (a;) — F(a:~1) = F() — F(a). 
i=1 
Since 
L(P.f) )s Dost) )Axi <U(P, f), 
we have 


IA 
o— 
ba 

= 
8 
~—" 
Q 

8 


b 
; f(a) de < F(b) — F(a) 


Thus if f is Riemann integrable on [a, }], 


b 
/ f(x) dx = F(b) — F(a). 


Remark. The above version of the fundamental theorem of calculus is con- 
siderably stronger than the version given in most elementary calculus texts in 
that it does not require continuity of the function f. We only need that f is 
integrable and that it has an antiderivative on [a,b]. We will illustrate this in 
(b) of the following example. 


?The quantity F(b) — F(a) is usually denoted by F(x)|°. 
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EXAMPLES 6.3.3 (a) If f(a) = «",n EN, then F(x) = yj a"t! is an 
antiderivative of f. Thus for any a,b € R, a < 8, 


b 
/ x” dz = (yn —a®tt), 
. n+1 


(b) Consider the function F’ on [0,1] defined by 


1 

x sin —, x #0, 
x 

0, xr=0. 


A straightforward computation gives 


1 1 
cos — + 2x sin —, x #0, 
x x 


0, xr=0. 


f(a) = F(a) = 


Then f is bounded on [0,1] and continuous everywhere except x = 0. Thus 
f € RO, 1], and by the previous theorem 


[i = F(1) — F(0) =sin1. 
0 


(c) Let f be defined on [0,2] by 


and for x € [0,2] let F(x) be defined by 
F(x) -| f(O dt. 
0 
If0 <a <1, then F(x) = [1dt =z. On the other hand, if 1 < x < 2, then 
0 
; ‘ Lg 3 
F(x) =f rae+ [ (1—t)dt = -a* -—a44+-. 


Thus 


x, O0<2<1, 
F(@)=41 5 3 
5u° —2+5, 1Ll<ax<2. 
Even though f is not continuous at « = 1, the function F is continuous 


everywhere. This in fact is always the case. (See Exercise 2.) 
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The following version of the fundamental theorem of calculus, also due 
to Cauchy, proves that for continuous functions, integration is the inverse 
operation of differentiation. 


THEOREM 6.3.4 (Fundamental Theorem of Calculus) Let f ¢€ 
Ra, b]. Define F on [a, b] by 


Fa) = f° soa, 


Then F is continuous on [a,b]. Furthermore, if f is continuous at a point 
c€ [a,b], then F is differentiable at c and 


Proof. The proof that F’ is continuous is left as an exercise (Exercise 2). 
Suppose f is continuous at c € [a,b). We will show that F’.(c) = f(c). Let 
h > 0. Then by Theorem 6.2.3, 


cth c c+h 
Fle+h)- Fe) = [ fiae— f° seyae= f f(t) dt 
Therefore, 


Hes =e Ho=5f F(t) dt — Fle) 
i i 


=; [i -solar 
Let € > 0 be given. Since f is continuous at c, there exists a 6 > 0 such that 
If(t) — Flo) <€ 
for all t, |t — c| < 6. Therefore, if0<h <6, 


F(c+h) — F(c) 
’ #0) 


Ss 


cth 
? If) — Flat 


c 


cth 
i edt=e. 
Cc 


ss Ele r hy) F le) * 
iy, HAO = 1 


ie., Fi. (c) = f(c). Similarly, if f is continuous at c € (a,b), FL(c) = f(o), 
which proves the result. 


ate Sle 


Thus 
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Remarks. (a) If f is continuous on [a,b], then an antiderivative of f always 
exists; namely the function F' given by 


F(a) = f° soa, a<a<b. 


Since f is continuous, F’(#) = f(x) for all x € [a,b]. As a consequence, 
we obtain the following more elementary version of Theorem 6.3.2 normally 
encountered in the study of calculus: If f is continuous on [a,b] and G is any 


b 
antiderivative of f, then [ f = G(b) — G(a). 


(b) Integrability of a function f on [a,b] does not imply the existence of 
an antiderivative of f. For example, if f is monotone increasing on [a,b] and 
F(«) = f° f, then for any c € (a,b), Fi(c) = f(ct+) and F’(c) = f(c—) 
(Exercise 15). Thus if f is not continuous at c, the derivative of F’ does not 
exist at c. 


The Natural Logarithm Function 


As our first application of the fundamental theorem of calculus, we use the 
result to define the natural logarithm function In z. 


EXAMPLE 6.3.5 For x > 0, let L(x) be defined by 


Loe) = fo pat 


Since f(t) = 1/t is continuous on (0,00), by Theorem 6.3.4 L(x) satisfies 
L'(a) =1/z for all > 0. Furthermore, since L’(x) > 0 for all x € (0,00), L 
is strictly increasing on (0,00). 
We now prove that the function L(a) satisfies the usual properties of a 
logarithm function; namely 
(a) L(ab) = L(a) + L(b) for all a, b > 0, 
(b) L(1/b) = —L(b), b> 0, and 
(c) L(bk")=rL(b), b>0,reER. 
To prove (a), consider the function L(ax), « > 0. By the chain rule (The- 
orem 5.1.6). 
© ae) = ee aie L'(x). 
dx ax x 


Thus by Theorem 5.2.9, L(ax) = L(x) + C for some constant C. From the 
definition of ZL we have L(1) = 0. Therefore, 


La) 21 eC=C. 


Hence L(ax) = L(a) + L(x) for all x > 0, which proves (a). The proof of (b) 
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proceeds analogously. It is worth noting that for the proof of (a) and (b) we 
only used the fact that L’(#) = 1/a and L(1) = 0. 


To prove (c), if nm € N, then by (a) L(b”) =n L(b). Also by (b), 
Lib") =n (=) =-—nL(b). 
Therefore, L(b") = n L(b) for all n € Z. Consider L(*/b) where n € N. Since 
n L(*/b) = L(b), L(¥/b) = +L (b). Therefore 
L(b") =r L(b) 


for all r € Q. Since L is continuous the above holds for all r € R. 


Our final step will be to prove that L(e) = 1, where e is Euler’s number 
of Example 3.3.5. To accomplish this we use the definition to compute the 
derivative of L at 1. Since L’(1) exists, 


1=1/(1) = lim, i 
= lim nL(1+ 4) 
n—->co 
af dyny — 
= Jim L(d + =)") = Le). 
The last equality follows by the continuity of Z and the definition of e. There- 
fore L(e) = 1 and the function L(x) is the logarithm function to the base e. 


This function is usually denoted by log, x or Ina, and is called the natural 
logarithm function. 


Consequences of the Fundamental Theorem of Calculus 


We now prove several other consequences of Theorem 6.3.4. Our first result is 
the mean value theorem for integrals. 


THEOREM 6.3.6 (Mean Value Theorem for Integrals) Let f be a 
continuous real-valued function on [a,b]. Then there exists c € [a,b] such that 


[fF =s00-0 


Proof. Let F(x) = {” f. Since f is continuous on [a,}], F’(x) = f(x) for 
all x € [a,b]. Thus by the mean value theorem (Theorem 5.2.6), there exists 
c € [a,b] such that 


b 
[ f= FO-F@ =F Oba) = 1o0- 0) 


An alternate proof of the above can also be based on the intermediate 
value theorem using the continuity of f. This alternate method will be used 
in the proof of the analogous result for the Riemann-Stieltjes integral. 
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THEOREM 6.3.7 (Integration by Parts Formula) Let f, g be differen- 
tiable functions on [a,b] with f’, g’ € Ria, b]. Then 


b b 
/ fo! = F(0)9(b) — F(@g(a) — i of. 


Proof. Since f, g are differentiable on [a, b], they are continuous and thus also 
integrable on [a, b]. Therefore by Theorem 6.2.1(c), fg’ and gf’ are integrable 
on [a, 6]. Since 
(fo =of +f9', 
the function (f g)’ € R[a, b]. By the fundamental theorem of calculus (Theo- 
rem 6.3.2), 
b 


fOO)a(0) — Haale) = f (F9' = f cours i. sage 


from which the result follows. 


THEOREM 6.3.8 (Change of Variable Theorem) Let y be differen- 
tiable on [a,b] with yp! € RIa, b]. If f is continuous on I = y({a, b]), then 


7 p(b) 
/ flolt))o"(#) dt = i fla) de. 
7 (a) 


Proof. Since ¢ is continuous, I = y([a, b]) is a closed and bounded interval. 
Also, since foy is continuous and y’ € Ria, b], by Theorem 6.2.1(c), (foy)y’ € 
Ra, b]. If I = y([a, b]) is a single point, then y is constant on [a,b]. In this 
case, y’(t) = 0 for all t and both integrals above are zero. Otherwise, for x € I 


define " 
F(x) = s) ds. 
(x) [ iO 


Since f is continuous, F’(x) = f(x) for all x € I. By the chain rule 


“ F(t) = Fi(g(t)e') = fee 


for all t € I. Therefore by Theorem 6.3.2 
pb) 


b 
/ f(v(t))y' ®) dt = F(v(6)) — F(y(a)) = / {es 


Remark. Another version of the change of variable theorem is given in Ex- 
ercise 11. 
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EXAMPLES 6.3.9 (a) To illustrate the change of variable theorem, con- 
2 

sider f t/(1 +t?) dt. If we let y(t) = 1+ ¢? and f(x) =1/z, then 
0 


[ et=3/ seoowoe, 


1+? 


which by Theorem 6.3.8 
1 fa, 1 
==] —de==In5. 
>/ eo Oe 


(b) For integrals involving Va? — x2, Vx? — a?, and Vx? + a2, an appro- 
priate trigonometric substitution is useful in evaluating the integral. We illus- 


trate this with the following. Find | Va? — «dx. We make the substitution 
0 


x=asint, 0<t< 
Then dz = acost dt and Va? — x? = acost. Thus 
a z 
[ ver ae =o? | cos’ t dt, 
0 0 


which by the identity cos? t = $(1 + cos 2t) 


2 


2 5 1 5 
-5/ (1+ cos 2t)dt =~ |t+=sin2t]| = 
rae 2 D : 


NI 
a 


Tv 
A : 


Exercises 6.3 


1. Sketch both the graph of f(x) and the graph of F(x) of Example 6.3.3 
(c). 


2. *Let f € Ria, bj. For x € [a,b], set F(x) = f f. Prove that F' is continuous 


on [a, b]. 


3. For x € [0,1], find F(x) = f f(t)dt for each of the following functions f 
0 
defined on [0,1]. In each case verify that F' is continuous on [0,1], and 
that F(x) = f(x) at all points where f is continuous. 
1, 0 
—2, $ 
ce. f(z) =a — [3a] *d f(x) = 2[3a]. 


a. f(z) =2° — 3245 *b. f(x) = 


256 


10. 


11. 


£2. 
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t 0<t<l 
en ae *, and let F(x) be 
b-t?,  1<t<2, 


Let f(t) be defined by f(t) = 
defined by F(x) = ff@ dt, O<ar<2. 
0 


a. Find F(z). 


b. For what value of 6 in the definition of f is F(x) differentiable for all 
x € (0, 2]. 


Let f be a continuous real-valued function on [a, 6] and define H on [a, }] 
b 
by H(x) = f f. Find H'(z). 


x 


Find F’(x) where F is defined on [0, 1] as follows: 


a. F(x) = i, —— dt *b. F(x) = i, cos t* dt 
o 1+ 0 


c. F(x) =f Jed 


2 
*d. F(x) = f f(t) dt, where f is continuous on (0, 1] 
0 


*Let L(x) be defined as in Example 6.3.5. Prove that L(1/x) = —L(2). 
Let f : R-— R be continuous. For a > 0 define g on R by 


Show that g is differentiable and find g’(z). 


Suppose f : [a,b] > R is continuous and g,h : [c,d] — [a, b] are differen- 
tiable. For x € [c, d] define 


g(x) 
H()= f f(t)at. 
h(a) 
Find H'(z). 


*Let f be a continuous real-valued function on [a,b], g € Ria, b] with 
g(x) > 0 for all x € [a,b]. Prove that there exists c € [a,b] such that 


f F@)glo)de =f ore 


Prove the following change of variables formula: Let y be a real-valued 
differentiable function on [a, b] with y’(x) 4 0 for all x € [a,b]. Let w be 
the inverse function of y on I = y([a,b]). If f : J > R is continuous on 
I, then 

p(b) 


f(y(a))dx = f f(t)p'(t) dt. 


(a) 


Poe 


Evaluate each of the following integrals. Justify each step. 


2 Oe Fanaa ox 
a, i. ie dx. *b. if vitve dz. 
1 & rT Va 
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13. 


14. 


15. 


16. 


17. 


18. 


1 © 
c. | zlna, dx. a. | tVat+bdt, a,b>0. 
0 ) 
1 4 
*e, ve dz. f. / — dz. 
9 l+VWxr 1 aVct1 
Use the suggested trigonometric substitution to evaluate each of the fol- 
lowing integrals. 


x= asint, —30 <t< 


a x? 
a. dx, 
—a Va? — x? 


x=atant, O<t< 


a 
1 
*b. dx 
[ JVa2+a2-” 
2a 
c. Va? —adx, x =asect, O<t< jn 


0 
*Suppose f : [a,b] > R is continuous. Let M = max{|f(x)| : x € [a, b]}. 
Show that 


1/n 
Jim, (f \N(a)!"ae) = M. 


*Let f be a monotone increasing function on [a,b] and let F(x) = 
b 


f(t) dt. Prove that Fi.(c) = f(c+) and F’(c) = f(c—) for every 
ce (a, b). 


Use Theorem 4.4.10 and the previous exercise to construct a continuous, 
increasing function F’ on [0,1] that is differentiable at every irrational 
number in [0,1], and not differentiable at any rational number in (0, 1). 


(Cauchy-Schwarz Inequality for Integrals) Let f, g € Rla, b]. Prove 


that 
‘< ([ Pear) ([ sar), 


[ 109912) a0 


(Hint: For a, 6 € R consider fr(af — Bg). ) 


(The Exponential Function) As in Example 6.3.5, let L : (0,00) +R 
be defined by 


ays - vat. 


a. Show that L is strictly increasing on (0,00) with Range L = R. 


b. Let E : R > (0,00) denote the inverse function of L. Use Theorem 
5.2.14 to prove that E’(x) = E(x) for all x € R. (The function F is called 
the natural exponential function, and is often denoted by exp (z).) 


c. Prove that E(a+y) = E(x)E(y) for all z, y ER. 


d. Prove that E(x) = e® for all x € R, where e is Euler’s number, and e” 
is as defined in Miscellaneous Exercise 3 of Chapter 1. 
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6.4 Improper Riemann Integrals 


In the definition of the Riemann integral of a real-valued function f, we re- 
quired that f be a bounded function defined on a closed and bounded interval 
(a, b|. If these two hypothesis are not satisfied, then the preceding theory does 
not apply and we have to make some modifications in the definition. In this 
section, we will briefly consider the changes that are required if the function 
f is unbounded at some point of its domain, or if the interval on which f is 
defined is itself unbounded. 


Unbounded Functions on Finite Intervals 


If f € Ria, b] with |f(x)| < M for all x € [a,b], then by Theorem 6.2.3 
f € Rc, b] for every c € (a,b), and 


fr-[4- [als finsae-a 


As a consequence, if f € Ra, b], then f € R{c, b] for every c € (a,b) and 


b b 
im [f= fs 


Suppose now that f is a bounded real-valued function defined only on (a, }] 
with f € R[c, b] for every c € (a,b). If we define f(a) = 0, then f is a bounded 
function on [a,}] satisfying f € R[c,b] for every c € (a,b). By Exercise 5, 
Section 6.2, f € Rla, b] with 


tim [t= [or 


Furthermore, by Exercise 3 of Section 6.2 the answer is independent of how 
we define f(a). 

Using the above as motivation, we extend the definition of the integral to 
include the case where f becomes unbounded at an endpoint. This extension 
of the integral is also due to Cauchy. 


DEFINITION 6.4.1 Let f be a real-valued function on (a, 6] such that f € 
Rc, b] for every c € (a,b). The improper Riemann integral of f on (a, 0], 


b 
denoted | f, is defined to be 


b b 
[rom [i 


provided the limit exists. If the limit exists, then the improper integral is said 
to be convergent. Otherwise, the improper integral is said to be divergent. 
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A similar definition can also be given if f is defined on [a, b) and becomes 
unbounded at b. If f becomes unbounded at a point p, a < p < b, we consider 
the improper integrals of f on the intervals [a,p) and (p, 0]. If each of the 
improper integrals exist, then we define the improper integral of f on [a, b] to 


be the sum 
‘D b 
pasfe 
a P 


EXAMPLES 6.4.2 (a) Consider the function f(x) = 1/x on (0,1). This 
function is clearly unbounded at 0. Since f is continuous on (0, 1], f € R[c, 1] 
for every c € (0,1). By Example 6.3.5 


1 
1 
if —dx = Ine. 
peal 


To evaluate pee Inc, we consider Inr”, where 0 < r < 1 andn EN. Since 


Inr” Seine oad ae: 
lim Inr” = lim n Inr = —oo. 
noo noo 


Therefore, since r” + 0 as n > oo and Inz is monotone increasing 


lim, Inc = —oo. Thus the improper integral of 1/x on (0, 1] diverges. 
c>0 


(b) For our second example we consider the improper integral of 
L(x) = Inz on (0,1). Since L(x) is continuous on (0, 1], L € Rc, 1] for every 
1 


€ (0,1). Consider f Inadz. If we take g(x) = x, then by the integration by 


parts formula, 


[near = [ ree) dx 


= L()g(1) = Log(e) — f '(a)ge) ae 
=-—clnce—l-+e. 


By the substitution c = 1/t, t > 0, and l’Hospital’s rule, 


—Int 1 
lim clne= lim erga lim — = 0. 
c>0+ tooo «6 too t 
Therefore, 
1 
lim Ingdx = -1. 


c30t 


Hence the improper integral of Ina converges on (0, 1] with 


1 
it Inadx = -1. 
) 
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(c) Consider the function f defined on [—1, 1] by 


-l<2<Q, 
: O0<a<l. 


Here f is unbounded at 0. For this example, the improper integral of f over 
[—1,1] fails to exist because the improper integral of f over (0,1] does not 
exist. 


(d) There are some significant differences between the Riemann integral 
and the improper Riemann integral. For example, if f € [a,b], then by 
Theorem 6.2.1 f? € Ra, b]. This however is false for the improper Riemann 
integral! For example, if f(x) = 1//z, x € (0,1), then 


L Af 
i : a , 
[een am [ eee ia e-wo=2 


Thus the improper integral of f converges on (0, 1]. However, f?(x) = 1/2, 
and the improper integral of 1/x on (0, 1] diverges. Also, if f € R[a, b], then 
| f| € Ra, b]. This again is false for improper Riemann integrals. A function f 
for which the improper integral of f converges, but the improper integral of 
| f| diverges is given in Exercise 4. 


Infinite Intervals 
We now turn our attention to functions defined on infinite intervals. 
DEFINITION 6.4.3 Let f be a real-valued function on [a,co) that is Rie- 


mann integrable on [a,c] for every c > a. The improper Riemann integral 
of f on [a,oo), denoted ya f, ts defined to be 


/ f = lim f, 
a co Ja 


provided the limit exists. If the limit exists, then the improper integral is said 
to be convergent. Otherwise, the improper integral is said to be divergent. 


If f is a real-valued function defined on (—oo, }] satisfying f € R[c, b] for 
every c < b, then the improper integral of f on (—oo, ] is defined as 


b b 
i, f= lim f, 
SS c4—0o fy 


provided the limit exists. If f is defined on (—co, 00), then the improper inte- 


gral of f is defined as 
Dp ee) 
for+fs 
as 
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for some fixed p € R, provided that the improper integrals of f on (—co, p] 
and [p,oo) are both convergent. For a function f defined on (—co, oo), care 
must be exercised in computing the improper integral of f. It is incorrect to 


compute 
Cc 


lim ae 
Cc Oo 
For example, if f(a) = 2, then 
. a a oe 
Be oe Bee ea 


Cc 


However, the improper integral of f on (—oo, 00) is divergent since 


coo coco 


is f = lim [ae = lim 5c? = 00. 


Remark. If f is nonnegative on [a,oo) with f € Ria, c] for every c > a, then 


J f is a monotone increasing function of c on [a,oo). Thus lim f f exists 
a Cc OOo a 
either as a real number or diverges to oo. For this reason, if f(a) > 0 for all 


x € [a, co), we use the notation 


[ fear <0 or [ swae= 


to denote that the improper integral of f on [a,co) converges or diverges 
respectively. 


EXAMPLES 6.4.4 (a) Let f(x) = 1/2?, x € [1, 00). Since f is continuous 
n [1,co), f € RII, c] for every c > 1. Therefore, 


1 
i f = lim de = Jim u (-2+1) =1. 
coo Cc 6 


Thus the improper integral converges to the value 1. 

(b) In this example, we consider the function f(a) = (sinz)/a, x € [7, 00). 
Since f is continuous, f € R[z,c] for every c > z. This function has the 
property that the improper integral of f on [7, co) converges, but the improper 
integral of |f| diverges. The proof of the convergence of the improper integral 
of f is left as an exercise (Exercise 7). Here we will show that 


- °° | sin | 
/ vis [al 5 ys 
Tv Tv x 
For n € N, consider 


ee | sin x| w=yf" | sin x| Ant 
wT v hap Ukr zt 
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Since the integrand is nonnegative, 


(k+1)m | o (k+3)q | 
i, | sin | a> [ a” | sin a| sie 
kr x (k+ 4) v 


On the interval [(k + 4), (k + ?)z], |sina| > V2/2. Also, 


1 1 
2 Gap, wraleelet a7, (k + 9)q]. 
Therefore 
(k+3)m | 2 1 24 
s 4/™ | sin a| des v2 [(k 3) qr (k + 4) oe , 
Gandy ‘A 2 (k+1)r 4 k+1 


and as a consequence 
(n+1)m | 9; pr 
/ En ee ye 1 
- x 4 | k+1 


By Example 3.7.4 the series }> 1/k diverges. Therefore, 


k=1 
Colo (n+1)r : 
/ ae lim (Lc eee 
= xv n+00 J Lv 


As the previous example shows, the convergence of the improper integral 
of f does not imply the convergence of the improper integral of |f|. If f is 
a real-valued function on [a,oo) such that f € Rla,c] for every c > a and 
the improper integral of || exists on [a,oo), then f is said to be absolutely 
integrable on |a, oo). An analogous definition can also be given for unbounded 
functions on a finite interval. We leave it as an exercise to prove that if f is 
absolutely integrable on [a, oo), then the improper integral of f also converges 
on [a,0oo) (Exercise 5). 

We conclude this section with the following useful comparison test for 
improper integrals. 


THEOREM 6.4.5 (Comparison Test) Let g : [a,co) > R be a nonneg- 
ative function satisfying g € Rla,c] for every c >a and f g(x)dx < oo. If 
f:[a,co) >R satisfies 


(a) f € Ra, c] for every c >a, and 
(b) |f(«)| < g(a) for all x € [a,co), then the improper integral of f on 


if ” f(0) dx| < / * g(a)de. 


[a,0o) converges, and 
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Proof. The proof is left to the exercises (Exercise 6). 


Exercises 6.4 


1. For each of the following functions f defined on (0, 1], determine whether 
1 
the improper integral of f exists. If it exists, find f f. 
0 


Vi-« 


*d. f(x) =alna e. f(x) = ( 
*f. f(x) = tan (52) 


2. For each of the following determine whether the improper integral con- 
verges or diverges. If it converges, evaluate the integral. 


*a. / e dx b. i: - dx ¥e, / x Pdz,p>1 
O : ae ae i Lo i 
nz 
d. —d. *e, — f. 1 
| z | x Ing / z(nayp’? 


ay [| —*_a nf a 1 
e | eee ‘|, @+ip x, p> 


3. For each of the following, determine the values of p and q for which the 
improper integral converges. 
1 


*a, i a?|Ina|’dx  b. / a?’(Ina)'dr cc. / x? [In(1 + x)|?dx 
0 2 0 
4. Let f be defined on (0, 1] by 
d 2. 1 a, til 2 
f(x) = a (« sin =) 2x sin a? 088 


Show that the improper Riemann integral of f converges on (0, 1], but 
that the improper integral of |f| diverges on (0, 1]. 


*a, f=, O0<p<1 b. f(a)= 


8 
8 


1 
1+2)m(1+2) 


1 
v2" 


5. *If f is absolutely integrable on [a, oo), and integrable on [a, c] for every 
c > a, prove that the improper Riemann integral of f on [a,0o) exists. 


Prove Theorem 6.4.5. 


7. Let f(x) = = x € [m, 00). 
x 
*a. Show that the improper integral of |f| converges on [7, 00). 
sing 1. 


*b. Use integration by parts on [7,c],c > 7, to show that f 
Tv 


exists. 
8. Show that fo? sin xdx converges for all p, 0 < p< 2. 
9. For xz>0, - 
(a2) = fete dt. 
0 


The function I is called the Gamma function. 


*a. Show that the improper integral converges for all x > 0. 
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b. Use integration by parts to show that [(a+1)=aI(«), « > 0. 
c. Show that ['(1) = 1. 
d. For n EN, prove that [(n +1) =nl!. 


6.5 The Riemann-Stieltjes Integral’ 


In this section, we consider the Riemann-Stieltjes integral, which as we will 
see is an extension of the Riemann integral. To motivate the Riemann-Stieltjes 
integral we consider the following example from physics involving the moment 
of inertia. 


EXAMPLE 6.5.1 Consider n-masses, each of mass m;, i = 1,...,n, located 
along the «z-axis at distances r; from the origin with 0 <r) <--- < rp, (Figure 
6.7). The moment of inertia J about an axis through the origin at right angles 
to the system of masses is given by 


n 


f=> me 


i=l 


On the other hand, if we have a wire of length @ along the x-axis with one 
end at the origin, then the moment of inertia J is given my 


e 
i=) x? p(x) dx, 
0 


where for each x € [0,4], p(#) denotes the cross-sectional density at x. 


FIGURE 6.7 
Example 6.5.1 


Although these two problems are totally different, the first being discrete 
and the second continuous, the Riemann-Stieltjes integral will allow us to 
express both of these formulas as a single integral. In the definition of the 


3Since the results of this section are not specifically required in subsequent chapters, this 
topic can be omitted. 
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Riemann integral we used the length Az; of the ith interval to define the 
upper and lower Riemann sums of a bounded function f. The only difference 
between the Riemann and Riemann-Stieltjes integral is that we replace Ax; 
by 
Aa; = a(a;) — a(a;_1), 

where a is a nondecreasing function on [a,b]. Taking a(x) = x will give the 
usual Riemann integral. Although the modification in the definition is only 
minor, the consequences however are far reaching. Not only will we obtain 
a more extensive theory of integration, we also obtain an integral which has 
broad applications in the mathematical sciences. 


Definition of the Riemann-Stieltjes Integral 


Let a be a monotone increasing function on [a,b], and let f be a bounded 
real-valued function on [a,b]. For each partition P = {29,21,...,a} of [a,b], 
set 

Aa; = a(a;) — a(a_1), t= Lawaih 


Since a is monotone increasing, Aa; > 0 for all i. As in Section 6.1, let 


= inf{ f(t) :tE [ei-1, Za], 
M; = sup{f(t) :t € [a;_1, a,]}. 


As for the Riemann integral, the upper Riemann-Stieltjes sum of f with 
respect to a and the partition P, denoted U(P, f,a), is defined by 


U(P, fra = So Mido 


Similarly, the lower Riemann-Stieltjes sum of f with respect to a and the 
partition P, denoted L(P, f, a), is defined by 


L(P, f,a = oma. 


Since m; < M; and Aa; > 0, we always have L(P, f,a) < U(P, f,a). 
Furthermore, if m < f(a) <M for all a € [a,}], then 


m|a(b) — a(a)] < L(P, f,a) < U(P, fa) < M [a(b) — a(a)], (10) 
for all partitions P of [a,b]. Let P be any partition of [a,b]. Since M; < M for 
all i and Aa; > 0, 


S° MjAa; < S> M Aaj = M S~ Aa; = M[a(b) - a(a)).- 
i=1 t=1 


i=l 
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Thus U(P, f,a@) < M [a(b) — a(a)]. The other inequality follows similarly. In 
the above we have used the fact that 


Ds Aa; = (a(#1) — a(#o)) + (a(w2) — a(v1)) +--+ + (alan) — a(@n-1)) 


= a(Ln) — a(x) = a(b) — a(a). 


In analogy with the Riemann integral, the upper and lower Riemann- 
Stieltjes integrals of f with respect to a over [a,b], denoted ie fda and 
ic f da respectively, are defined by 


pb 

l fda = inf {U(P, f,a):P is a partition of [a,b]}, 
i. 

i: fda =sup{L(P, f,a):P isa partition of [a, b]}. 


By inequality (10) the set {U(P, f,a) : P is a partition of [a, b]} is bounded 
below, and thus the upper integral of f with respect to a exists as a real 
number. Similarly, the lower sums are bounded above and thus the supremum 
defining the lower integral is also finite. As for the Riemann integral, our first 
step is to prove that the lower integral is less than or equal to the upper 
integral. 


THEOREM 6.5.2 Let f be bounded real-valued function on [a,b], and a a 
monotone increasing function on [a,b]. Then 


[tees fra 


Proof. As in the proof of Lemma 6.1.3, if P* is a refinement of the partition 
P, then 
LIP; f,0) < LP", f,0) SUP", f,0) SUP, fa). 


Thus if P, Q are any two partitions of [a, b], 
L(P, fa) <L(PUQ, f,a) <U(PUQ, f,a) <U(Q, f,a). 


Therefore L(P, f,a) < U(Q, f,a) for any partitions P, Q. Hence 


b 
/ f dea = sup £(P, f.a) <U(Q, fra) 


for any partition Q. Taking the infimum over Q gives the result. 
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DEFINITION 6.5.3 Let f be a bounded real-valued function on [a,b], and 


a a monotone increasing function on |a,b]. If 


| fue = [fae 


then f is said to be Riemann-Stieltjes integrable or integrable with re- 
spect to a on [a,b]. The common value is denoted by 


i “Paes. ie i ‘f@tl@s 


and is called the Riemann-Stieltjes integral of f with respect to a. 


As was indicated previously, the special case a(z) = x gives the usual 
Riemann integral on [a, }]. 


EXAMPLES 6.5.4 (a) Fix a < c < b. As in Definition 4.4.9, let [.(x) = 
I(a —c) be the unit jump function at c defined by 


0, nr<C, 
raey= {' r>ec 


We now prove the following: If f is a bounded real-valued function on [a, 6] 
that is continuous at c, a <c< b, then f is integrable with respect to J, and 


[sat = [se di(e— 8) = FO: 


For convenience, we set a(x) = I,(x), which is clearly monotone increasing on 
[a, b]. Let P = {20, 21,...,%n} be any partition of [a,b]. Since a < c < b, there 
exists an index k, 1 < k <n, such that 


PEAT RE STE 
Then 


Aag = a(ag) — A(@p-1) =1—-0=1, and 
Aa;= 0, for all iFk. 


Therefore 


U(P, f,a) = MpAa,x = My = sup{ f(t): ae-1 < t < az}, and 
E{P, fa) =mpAo, = my = inf { f(t) seer St < Ze}. 


Since f is continuous at c, given « > 0 there exists a 6 > 0 such that 


fl)-e<f)<flote 
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for all t € [a, b] with |t—c| < 6. If P is any partition of [a, b] with x;—-a,;_1 <6 
for all 7, then 
f(c) —e< me < My < f(d) +. 


Therefore f(c) —e < L(P, f,a) < U(P, f,a) < f(c) +e. As a consequence 


b pb 
fe)-es | fdas f fins fore 


Since € > O was arbitrary, the upper and lower integrals of f are equal, and 
thus f is integrable with respect to a@ on [a, b] with 


[ sea= 100, 


(b) The function 
_ji, ceEQ 
no= 1h x ¢Q, 


is not integrable with respect to any non-constant monotone increasing func- 
tion a. Suppose a is monotone increasing on [a,b], a < b, with a(a) 4 a(b). 
If P = {xo, 21, ..., Un} is any partition of [a,b], then m; = 0 and M; = 1 for 
all i = 1,...,n. Therefore L(P, f,a) = 0 and 


Uu(P, f,a) = pe Aa; = a(b) — a(a). 


Thus f is not integrable with respect to a 


Remark: It should be noted that in Example 6.5.4(a) only left continuity of 
f at cis required (Exercise 2(a)). 

The following theorem, which is the analogue of Theorem 6.1.7 for the 
Riemann integral, provides necessary and sufficient conditions for the existence 
of the Riemann-Stieltjes integral. The proof of the theorem follows verbatim 
the proof of Theorem 6.1.7 and thus is omitted. 


THEOREM 6.5.5 Let a be a monotone increasing function on [a,b]. A 
bounded real-valued function f is Riemann-Stieltjes integrable with respect to 
a on [a,b] if and only if for every « > 0, there exists a partition P of [a,)] 
such that 

U(P, f,a) —L(P, fra) <e. 


Furthermore, If P is a partition of [a,b] for which the above holds, then the 
inequality also holds for all refinements of P. 


We now use the previous theorem to prove the following analogue of The- 
orem 6.1.8. Except for some minor differences, the two proofs are very similar. 
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THEOREM 6.5.6 Let f be a real-valued function on [a, b] and a a monotone 
increasing function on [a, 6]. 

(a) If f is continuous on [a,b], then f is integrable with respect to a on 
[a, 6]. 

(b) If f is monotone on [a,b] and a is continuous on [a,b], then f is 
integrable with respect to a on [a,b]. 


Proof. (a) The proof of (a) is identical to the proof of Theorem 6.1.8(a) except 
that given € > 0, we choose 7 > 0 such that 


[a(b) — a(a)]n <e. 


The remainder of the proof now follows verbatim the proof of Theorem 
6.1.8(a). 

(b) For any positive integer n, choose a partition P = {20,21,...,%n} of 
[a, 6] such that 


Aa; = a(a;) — a(aj_1) = * (a(t) —a(a)]. 


Since a@ is continuous, such a choice is possible by the intermediate value 
theorem. Assume f is monotone increasing on [a,b]. Then M; = f(x;) and 
m,; = f(ai-1). Therefore, 


n 


Uu(P, f,a) —L(P, f,a) = > Ifa) — f(aj_-1) Aa; 
= OO) 0) I Flas) - Flea) 
SOO OO 05) = Fay): 


n 


Given € > 0, choose n € N such that 


[a(b) — a(@)] 


n 


[F(b) — F(a) <«. 


For this n and corresponding partition P, U(P, f,a) — L(P, f,a) < €, which 
proves the result. 


Remark. In part (b) above, the result may be false if a is not continuous. 
For example, if a < c < b, then the monotone function J, is not integrable 
with respect to I, on [a,b] (Exercise 2(b)). 


Properties of the Riemann-Stieltjes Integral 


We next consider several basic properties of the Riemann-Stieltjes integral. 
For notational convenience, we make the following definition. 
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DEFINITION 6.5.7 For a given monotone increasing function a on [a,b], 


Ria) denotes the set of bounded real-valued functions f on [a,b] which are 
Riemann-Stieltjes integrable with respect to a. 


THEOREM 6.5.8 
(a) If f,g € Ria), then f +g and cf are in R(a) for every cE R, and 


[rrode= [saat [ode and [octaame [sae 


(b) If f € R(a;), i =1,2, then f € R(a, + a2) and 


[salou toa) = fpdort ff os 


(c) If f € R(a) anda<c< bb, then f is integrable with respect to a on 


[a,c] and [c, b] with 
[sean [tao [pee 


(d) If f,g € R(a) with f(x) < g(a) for all x € [a,b], then 


b b 
[ feas f gc. 


(e) If |f(x)| < M on [a,b] and f € R(a), then |f| € R(a) and 


[se 


Proof. We provide the proofs of (b) and (e). The proofs of (a), (c), and (d), 
along with other properties of the Riemann-Stieltjes integral are left to the 
exercises. 


(b) Since f € R(a;), given € > 0, there exists a partition P;, 7 = 1, 2, such 
that . 
U(Pi, f, ai) — L(Pi, f,au) < 5° (11) 


Let P = Pi UP2. Since P is a refinement of both P; and P2, inequality (11) 
is still valid for the partition ?. Thus since 


b 
< f |flda< M [a(b) - a(a) 


A(ay + ag); = A(a1); - A(a2)i; 
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for alla =1,...,n 


U(P, far p ag) _ L£(P, f,a4 + Q2) 
=U(P, f,01) — L(P, f,a1) +U(P, f,02) — L(P, fran) <= + 5 =e. 


i) 


Therefore by Theorem 6.5.5, f € R(ai + a2). Furthermore, for any partition 
P of [a, 0], 


L(P, f,a1 + a2) = L(P, f,a1) + L(P, f, a) 
< [sans [ f daz 
<U(P, fra) +U(P, f,a2z) =U(P, f,a1 + az). 


Thus since f € R(a1 + a2), 


[ fea + ey) =f sdort [ fdes 


(e) Suppose f € R(a) and P = {x0, %1,...,%n} is a partition of [a, b]. For 
each 7 = 1,...,7, let 


M; = sup{f(t) : t € [xi-1, zi]}, M; = sup{|f(¢)| : t € [zi-1, zi]}, 
m, = inf{ f(t): ¢ € [a;_1, z]}, ms = inf{|f(é)| +t © [wi_1, vaJ}. 


If t,x € [aj_1, 2], then 


HAO! —lf@IIs 


Thus M* — mF < M; — m,, for all i = 1,...,n, and as a consequence 


U(P, lf, @) _ ERs lf, @) < U(P, f,@) w L(P, ies e 
Therefore, by Theorem 6.5.5, |f| € R(a). Choose c = +1 such that ¢ [ f da > 


0. Then 
b b b b 
[ fea =of fda= | cfda< | |f| da 


b 
<M if toi =ala\- 


f(t) — f(x)| < Mi — mi. 


As for the Riemann integral, we also have the following mean value theorem 
and integration by parts formula for the Riemann-Stieltjes integral. 
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THEOREM 6.5.9 (Mean Value Theorem) Let f be a continuous real- 
valued function on [a,b], and a a monotone increasing function on [a,b]. Then 
there exists c € [a,b] such that 


b 
J f4a= Fal) ~ a(a)} 


Proof. Let m and M denote the minimum and maximum of f on [a,b] re- 
spectively. Then by Theorem 6.5.8(d), 


b 


m [a(b) — a(a)] < / fda: < M [a(b) — aa). 


a 


If a(b) — a(a) = 0, then any c € [a,b] will work. If a(b) — a(a) ¥ 0, then by 
the intermediate value theorem there exists c € [a,b] such that 


1 b 
f= ay | fia, 


which proves the result. 


THEOREM 6.5.10 (Integration by Parts Formula) Suppose a and 6 
are monotone increasing functions on [a,b]. Then a € R(B) if and only if 
BE Ria). If this is the case, 


b b 
/ adB = a(b)B(b) — o(a)B(a) - i Bda. 


a 


Proof. By Exercise 9, for any partition P of [a, dJ, 


U(P, a, B) = a(b)5(b) 
L£(P, a, B) = a(b)5(b) 


(a)B(a) —L(P,B,a), and 
(a)B(a) —U(P, B, a). 


—a 
—a 
Therefore, 


U(P,a, B) _ L(P 038) _ U(P, B, a) _ L(P, Ba). 


From this identity it immediately follows by Theorem 6.5.5 that a € R(8) if 
and only if 6 € R(a). Furthermore, if 6 € R(a), then given € > 0, there exists 
a partition P of [a,b] such that 


b 
L(P, B, a) >| Bda—e. 


Hence, 


b b 
/ adB <U(P, a, 8) < a(b)6(b) — a(a)(a)— f Bda+e. 
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Since the above holds for any € > 0, 


b b 
/ adB < a()B(b) — o(a)B(a) - / Bda. 


A similar argument using the lower sum proves the reverse inequality. 


We conclude this section with two results that represent the extremes 
encountered in Riemann-Stieltjes integration. As in Example 6.5.4(a), let I, 
be the unit jump function at c € R. Suppose {s,,}_, is a finite subset of (a, ] 
and {c,}_, are non-negative real numbers. Define the monotone increasing 
function a on [a, b] by 


N 
a(x) = s Cn1 (x — Sn). 


If f is continuous on [a, 6], then by Example 6.5.4(a) and Theorem 6.5.8(b), 


b N b N 
/ fda= a) f(a) dI (x — 8p) = Sen f (Sn). (12) 


Suppose {s,,}°2, is a countable subset of (a,b] and {c,}°2, is a sequence of 
nonnegative real numbers for which }>c, converges. As in Theorem 4.4.10 
define a on [a,b] by 


a(x) = S° ep La — &n). (13) 


Since 0 < I(x—5,,) < 1 for all n, the series in (13) converges for every x € [a, b], 
and a is a monotone increasing function on [a,b]. For such a function a we 
have the following theorem. 


THEOREM 6.5.11 Let f be a continuous real-valued function on [a,b] and 
let a be the monotone function defined by (13). Then f € R(a) and 


b io) 
[ f4a= dev Flom) 
a n=1 


Proof. Since f is continuous on [a,b], f € R(a) (Theorem 6.5.6(a)). Let « > 0 
be given. Choose a positive integer N such that 


Co 


.s Cn < €. 


n=N+1 


Define 6, and (2 as follows: 


N 
Bi(z)= So enI(a— sn), Balt) = >> en (a— 5p). 
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Then a = 6; + £2, and by identity (12) 


b N 
[ £48 = Sev Flom) 
a n=1 
Let M = max{|f(x)| : x € [a,b]}. Then by Theorem 6.5.8(b) and (e), 
b N b 
[ fa-Yenteon)]=|f fase 
a Wal a 


<M SO a<Me, 
n=N+1 


< M [62(b) — Ba(a)| 


which proves the result. 


At the other extreme, if the monotone function a is also differentiable, 
then we have the following result. 


THEOREM 6.5.12 Suppose f € Rla,b] and a is a monotone increasing 
differentiable function on [a,b] with a! € Ria, b]. Then f € R(a) and 


[seam f tae de 


Proof. Since both f and a’ are Riemann integrable on [a,b], by Theorem 
6.2.1(c), fa’ € Rla, b]. Let € > 0 be given. Since a’ € Ria, bj, by Theorem 
6.1.7 there exists a partition P of [a,b] such that 


U(P,a’') —L(P,a") <e. (14) 


Let O = {20,...,2n} be any refinement of P. As in Theorem 6.2.6, for each 
i=1,...,n, we can choose s; € [a;~-1, xj] such that 


U(Q, f,a) < Di S(si)Aai fe (15) 


By the mean value theorem, for each i = 1,...,n, there exists t; € [aj-1,2;| 
such that 
Aay = a(a%;) — a(xj_-1) = a(t) Aa; 


Therefore, 
S- f(s i)Aa, = Yo (s;)a’ (t;)Aa;. (16) 
i=1 


Let M = sup{|f(x)| : x € [a, |}, and for i = 1,...,n, let m; and M; denote the 
infimum and supremum respectively of a’ over the interval [x;_1, 2;]. Then 


|a’(s;) — a’ (ti)| < Mi — mj 
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for alli = 1,...,n. Therefore, 


YA) t,)Aa; — dN s;)a’(s;)Ax,) < TIA s;)||a”(t;) — a” (s;)| 


4=1 


i=l 


= M (U(Q,a’) — L(Q,a")) < Me. 


The last inequality follows by (14) since Q is a refinement of P. Therefore 
Yo Hae (am = sla) s;)Av; + Me <U(Q, fo’) + Me. 


Thus by (15) and (16), 
U(Q, f,a) <U(Q, fa’) + (M + Ie. 


Since fa’ € Ra, b], there exists a partition Q of [a,b], which is a refinement 
of P, such that 


b 
Uu(Q, fa’) <|/ fal +e. 
Thus = 
b b 
J fea< | fo’ + (M +4 2)e. 


Since this holds for any € > 0, 


[tue [1 


A similar argument using lower sums proves the reverse inequality. Thus f € 


R(a) and ; ‘ 
| fda = | fol. 


We now give several examples to illustrate the previous two theorems. 


EXAMPLES 6.5.13 (a) For our first example we illustrate the finite ver- 
sion of Theorem 6.5.11; namely, identity (12). Consider 


| * 6 dla}. 


[2] = I(a@ — 1) + I(x — 2). 


For x € (0, 2], 


276 Introduction to Real Analysis 


Therefore since e* is continuous, it is integrable with respect to [2], and by 
(12) 


2 
| e* diz] = e' + e?. 
0 


(b) To illustrate Theorem 6.5.12, if a(z) = 2? on [0,1], then for any 
Riemann integrable function f on [0, 1], 


f@\de =2 f(a)a de. 
0 0 


In particular, if f(z) = sina, then 


1 1 
| sinned? =2 xsinaax dx 
0 0 


which by the integration by parts formula 
1 re ae 
a —<2c08 r2| + - | cos Txdx 
T 0 Jo 


1 E 2 i 1 
=——cos7+ — sina =-. 
7 7 0 T 


(c) As another illustration of Theorem 6.5.12, 


| "[a]d(e2") = 2 i "[ale2ax 


2 3 
= 2 | e7" da + 2 Qe?" dx = 2e8 — e* — e?. 
1 2 


The Riemann-Stieltjes integral has important applications in a variety of 
areas, including physics and probability theory. It allows us to express di- 
verse formulas as a single expression. To illustrate this, we again consider the 
moment of inertia problem of Example 6.5.1. 


EXAMPLE 6.5.14 In this example, we will show that both formulas of 
Example 6.5.1 can be expressed as 


¢ 
i=] x? dm(x), 
0 


where m(ax) denotes the mass of the wire or system from 0 to x. Clearly the 
function m(x) is nondecreasing, and thus since x? is continuous, the above 
integral exists. 
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In the first case, since 0 < ry < rg < +--+: < Tn, and the masses m; are 
located at r; (see Figure 6.7), m(a) is given by 


i=1 


Thus by Theorem 6.5.11, 


l 
| x? dm(x r? mj. 
0) % 


On the other hand, if m(x) is differentiable and m’(x) is Riemann integrable, 
then by Theorem 6.5.12, 


[ a? dm(x) = [ a?m! (a) dx. 


It only remains to be shown that m’(x) is the density. The density p(a) of a 
wire (mass per unit length) is defined as the limit of the average density. In 
the interval [x, «+ Az], the average density is 
m(a + Ax) — m(a) 
Ax ; 
Thus if m(a) is differentiable, p(x) = m'(x). 


Riemann-Stieltjes Sums 


We conclude this section with a few remarks concerning Riemann-Stieltjes 
sums. As in Definition 6.2.4, let f be a bounded real-valued function on [a,b], 
a@ a monotone increasing function on [a,b], and P = {zo,...,¢,} a partition of 
(a, 6]. For each i = 1, 2,...,n, choose t; € [2;_1, 7;]. Then 


S(P, f, a) = st Aa; 


is called a Riemann-Stieltjes sum of f with respect to a and the partition 
P. 

A natural question to ask is whether the analogue of Theorem 6.2.6 is valid 
for the Riemann-Stieltjes integral. Unfortunately, only part of the Theorem 
holds. If ane S(P,f,a) = I, then f € R(a) on [a,b] and i fda=T1 

+0 
(Exercise 11). The converse, as the following example will illustrate, is false! 
However, if f and a satisfy either of the hypothesis of Theorem 6.5.6, then 


b 
fo fdo= tim S(P, fa). 


The result where f is continuous and a is monotone increasing is given as an 
exercise (Exercise 10). 
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EXAMPLE 6.5.15 Let f and a be defined on [0,2] as follows: 


rio) {" 0<2<1, 


Is Tee 2: 

0, 0<a<1, 
a(a) = 

i. l<r<2. 


Since f is left continuous at 1, by Example 6.5.4(a) Je fda = (1) = 0. 
Suppose P = {29,21,...,Un} is any partition of [0,2] with 1 ¢ P. Let k be such 
that vp-1 <1< az. Then Aay, = 1 and Aa; = 0 for alli 4 &. If ty, € (1, xg], 
then S(P, f,a@) = 1. On the other hand, if t, = 1, then S(P, f,a) = 0. Asa 
consequence, 


lim S(P,f,a 
IP\|>0 Pri?) 


does not exist. 


Exercises 6.5 


1 
1. *Evaluate f(x) da(xz) where f is bounded on [—1, 1] and continuous 
=A 


at 0, and a is given by 


—-1, x <0, 
a(e)=4 0, «=0, 
1s x> 0. 


2. a. In Example 6.5.4(a), prove that if the function f is left continuous at 
c, then f is integrable with respect to I. on [a, 6]. 


b. Show that J. is not integrable with respect to I. 

3. Let a be non-decreasing on [a,b]. Suppose f is bounded on [a,b] and 
integrable with respect to a on [a,b]. For x € [a,b] set F(x) = f f da. 
*a. Prove that |F(x)—F(y)| < M |a(x)—a(y)| for some positive constant 
M and all z, y € [a, b). 


b. Prove that if a is continuous at x, € [a, b], then F' is also continuous 
at Xo. 


4. a. Prove Theorem 6.5.8(a). 
b. Prove Theorem 6.5.8(c). 
c. Prove Theorem 6.5.8(d). 


5. Use the theorems from the text to compute each of the following integrals: 


n/2 3 3 
*a, i x d(sin x). b. / [a] da”. *G: / x” d[z}. 
0 0 0 


d. [elt ade? +e) e. [f sinmnata *f. [e-bye® 
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6. Verify the integration by parts formula with (b) and (c) of the previous 
exercise. 


1 
7. Find i: f da, where f is continuous on [0,1] and 
0 


co 
= 23 =! 
aio 
— 2" 
Leave your answer in the form of an infinite series. 


8. Let a be as in Exercise 7. Evaluate each of the following integrals. Leave 
your answers in the form of an infinite series. 


*a, [ede b. [ a(ax) dx 


9. Suppose a and 8 are monotone increasing on [a, b], and P is a partition 
of [a, b]. Prove that 


UP, a, B) = a(b)B(d) _ a(a)B(a) a L(P, B, a). 


10. Prove that if f is a continuous real-valued function on [a,b] and a is 
monotone increasing on [a, b], then iA S(P, f, a) exists and 
P\|0 


b 
lim S(P,f,a da. 
ppc’ ed Fee 


11. Let f be a bounded real-valued function on [a,b] and a a monotone 
increasing function on [a, b]. Prove the following: If an — (P,f,a) =T, 
> 


b 
then f € R(a) and f fda=I. 
12. *a. Let a be a monotone increasing function on [a, b]. If f € R(a), prove 
that f? € R(a). 
b. If f, g € R(a), prove that fg € Ria). 


13. If f € R(a) on [a,b] with Range f C [c,d], and ¢ is continuous on [c, d], 
prove that yo f € R(a) on [a, b}. 


14. Suppose f is a nonnegative continuous function on [a,b], and a is non- 
decreasing on [a,b] Define the function 6 on [a,b] by B(x) = f fda. If g 
1 


is continuous on [a, b], prove that 


[o9a2= [rode 


6.6 Numerical Methods* 


In this section, we will take a brief look at some elementary numerical meth- 
ods that are useful in obtaining approximations to Riemann integrals. Even 


4The topics of this section may be omitted on first reading. 
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though the fundamental theorem of calculus provides an easy method for eval- 
uating definite integrals, it is useful only if we can find an antiderivative of 
the function being integrated. To illustrate this, in Example 6.3.9 we showed 


that 
2 4 F 
— dt = 5 ln5. 
| i pit x Ind 


This however is not particular useful if we do not know the value of In5. By 


Example 6.3.5, 
Pal 
In5 =} — dt. 
1 t 


To obtain an approximation to In5, we can choose from several available 
methods for obtaining numerical approximations to the definite integral. 


Approximations Using Riemann Sums 


Since upper and lower sums are in general difficult to evaluate, Darboux’s defi- 
nition of the Riemann integral is not particularly useful in obtaining numerical 
approximations. The most elementary numerical method is to use Riemann 
sums. One of the first mathematicians to use numerical methods was Euler, 
who considered sums of the form 


n 
Sf (@e—1)(@e — te-1) 
k=1 


as an approximation to the integral. This is nothing but the Riemann sum for 
the partition P = {xo,%,...,%n} of [a,b] with t, = x,_ for all k. 

In using Riemann sums to approximate the integral of f it is convenient 
to take equally spaced partitions. Let n € N, and set h = (b— a)/n. Define 


t=a, M=ath, rcg=a4+2h,-++, tr =atnh=b. (17) 


Thus if P,, = {9,%1,...,U%n} with x; as defined, we always have Ax; = h for 
alli =1,...,n, and 


S(Pn;f) = Yost yan = AY sh) 


where for each i = 1,...,n, t; € [xj_1,x;]. If we take t; = x;_, for all 7, then 
we obtain the above formula of Euler. Similarly, we could take t; to be the 
right endpoint x; of the interval [x;~1,«;]. Another choice of t; would be the 
midpoint; ie., ¢; = (aj-1 + 2;)/2. For monotone functions, it is intuitively 
obvious that the midpoint gives a better approximation than either the right 
or left endpoint to the integral of f over the interval [7;_1, x;] (see Figure 6.8). 
With x; as defined by (17) and t; = (a1 + 2;)/2 the above formula becomes 


n 


M,(f) =h > flat (i- §)h). (18) 


i=l 
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epniemeadin 


FIGURE 6.8 
Midpoint approximation 


The quantity M,,(f) is called the nth midpoint approximation to the in- 
tegral of f over [a, }]. 

Regardless of the method used, it is important to be able to estimate the 
error between the true value and the approximate value. If f € R[a, bj, then 
for any partition P of [a,b], we always have 


b 
i f(a)dx — 8(P, f)| <U(P, f) — LIP, f) (19) 


for any choice of t, € [ap-1, 2%]. Inequality (19) follows from the fact that 
both the Riemann sum of f and the integral of f lie between the lower and 
upper sum of f. If f is monotone increasing on [a, 6], then by the proof of 
Theorem 6.1.8(b), 


U(Pn f) — L(Pn; f) = Al f(b) — F(a)].- 
Thus by inequality (19), 


b n 
[fear 0° fe] < MFO) = F(a) (20) 


for any choice of t; € [a;-1,2;]. Although we proved (20) for a monotone 
increasing function, the inequality is also valid for a monotone decreasing 
function. Thus for monotone functions, inequality (20) provides an estimate 
on the error between the true value and the approximate value. 


EXAMPLE 6.6.1 The function f(x) = 1/a is decreasing on [1,5]. Thus by 
inequality (20), for n € N and h = (b—a)/n, 


is 4|1 161 
In5—h ti)| < 1) = 
mba seal so [sa =F 
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for any choice of t; € [x;-1,2;]. Thus with n = 8, the error is less than 
2/5 = 0.4; n = 160 only guarantees an error of less than 1/50 = 0.02. We 
would be required to take very large values of n to be guaranteed a sufficiently 
small error. 

With n = 8, h = 1/2 and 2; = 14+ 72/2,7 = 0,1,...,8, and t; = a1 = 
(1+ 7)/2 (the left end point), 


8 
1 

i=l 
oleic Poly eg UG yd 
ee uk ae Cee a a ae 


= 1.8290 (to four decimal places). 


To four decimal places, In5 = 1.6094. Thus the error is 0.2196 which is less 
than the predicted error of 0.4. 


If we use the midpoint approximation (18) (again with n = 8), then t; = 
1+ (i— 4) which upon simplification equals (3 + 2i)/4. Thus 


9 15 
= 1.5998 (to four decimal places). 
Using the midpoint approximation the error is less than 0.01. This is consid- 


erably better than predicted by inequality (20). As we will shortly see, this 
improved accuracy is not a coincidence. 


Inequality (20) provides an error estimate for monotone functions. For arbi- 
trary real-valued functions, under the additional hypothesis that the derivative 
is bounded, we have the following theorem. 


THEOREM 6.6.2 Let f be a real-valued differentiable function on [a,b] for 
which f'(x) is bounded on [a,b]. Then for any partition P of [a,b], 


b 
/ f(a)dx — S(P, f)| < |PIIM(b — a), 


where M = sup{|f’(x)| : x € [a, b]}. 


Proof. Suppose P = {X0,1,...,2n} is a partition of [a,b]. Then 


n 


U(P, f) — L(P, f) = S-(Mi — mi) Aa. 


i=l 
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Since f is continuous on [a,b], for each 7 there exist s;, 5; € [a;-1,2;] such 
that 

M; — mi = f(si) — f(s;). 
By the mean value theorem, f(s;) — f (sj) 
s; and si. Therefore, since | f’(t;)||si — sj 


= f'(ti)(s; — 4) for some t; between 
< MPI, 


U(P, f) — L(P, f) <M [PI So An =| ||P || M(b a). 


w=1 


The result now follows by inequality (19). 


If f satisfies the hypothesis of the theorem, h = (b—a)/n, n € N, and the 
x; are defined by (17), then 


< M(b-a)h 


b n 
f(a)dx — ny fei) 


for any choice of t; € [a;-1,2;]. A slight improvement of this inequality is 
given in the exercises (Exercise 6). If E,,(f) denotes the error between the 
true value and the approximate value, that is, 


b 
= / f(a) de — S(Pns f); 


then the above inequality can simply be written as |E,,(f)| < Ch, where C 
is a fixed constant depending only on f and the interval [a, b]. Since the term 
“h” occurs to the first power, this method is commonly referred to as a first 
order method. 

In Example 6.6.1 we saw that the midpoint rule provided much greater ac- 
curacy than using the left end point. This is not a coincidence as the following 
theorem proves. 


THEOREM 6.6.3 If f is twice differentiable on [a,b] and f" (x) is bounded 
on [a,b], then 
M(b— a) 


(<< 


aS 


where M = sup{|f” (x)|: x € [a, b]}. 


Remark. Since the error between the true value and the approximate value in- 
volves the term h?, the midpoint approximation is a second order method. 


Proof. To prove the result, we first prove that for each 7 = 1,...,n, 


Ze, (21) 


fe )dx —h f(a+(i- +)h) S54 
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For t € [0,/2], consider the function 


cy tt 
g(t) = i f(a)dee — 2t (ci), 


4—t 


where ¢; = (aj-1 + 2;)/2. Then 
wp = f fe)de—h flat G— Hh). 


Since f is continuous, by Theorem 6.3.4, 


g(t) = fla t+t)+ fla—t)—2f'(q), and 
gi (t) = f(a +t) — f(a — 2). 


By the mean value theorem 
fc +t) -— f'(ce—t) = f"(C)2t 
for some ¢ € (cy —t, cy +t). Since | f”(¢)| < M, we obtain 
gi (t)| < 2Mt 


for all t € [0, h/2]. Since gi(0) = 0, by the fundamental theorem of calculus, 


col =| fot n)dz| < <f iste Nite < 2m fede = Me. 


Also, since g;(0) = 0, by the fundamental theorem of calculus again, 


h/2 h/2 M/h\3? M 
(2) = ‘ Es : <A 
jpl=|f> dena) s [Wows (5) =e. 


which proves inequality (21). Therefore, 


x)da — M _f@ )dx —hf(a+ (a 


(2) 3, _ M(b-a),, 
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(x4. -1)) 


= (x; f &)) 


Xi-1 xj 


FIGURE 6.9 
Trapezoidal approximation 


The Trapezoidal Rule 


We now consider another common second order approximation method known 
as the trapezoidal rule. In using Riemann sums, regardless of the choice of 
the points t;, we used rectangles to approximate the integral of the function f. 
In our second numerical method we will replace rectangles by trapezoids. Let 
f be a Riemann integrable function on [a, | and let P = {29,21,...,un} bea 
partition of [a,b]. As in Figure 6.9, for each interval [x;_1,x;], the area of the 
trapezoid formed by the points (#;_1,0), (a1, f(@i_1)), (vi, f(ai)), (a, 0) is 
given by $[f (a1) + f(x;)|Av;. Summing these up gives 


5 LU win) + Seider 


as an approximation to the integral of f on [a,b]. If as previously we set 
h=(b—a)/n and x; =a+ih,i=0,...,n, then the above sum becomes 


n—1 


f(a)+2 es f(a+ih) + f(b) 


5 lta + (i 1h) + f(a + ih)] = 


If f is Riemann integrable on [a,b] and n € N, the quantity T;,(f) defined by 


h 


eG a) = a5, 


| f(a) +2> Flat ih) + £0) 


i=l 


(22) 


where h = (b—a)/n, is called the nth trapezoidal approximation to the 
integral of f on [a,b]. If we set y; = f(a+ih), then T,,(f) can be expressed as 


n-1 


yot2 Soy + Yn 


i=l 


Taf) = 5 
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The following theorem, under suitable hypothesis on f, provides an esti- 
mate on the error of the trapezoidal approximation. 


THEOREM 6.6.4 If f is twice differentiable on [a,b] and f" (x) is bounded 
on [a,b], then 


2 —a 
[fear —T(9) < ne, 


where M = sup{|f’"(x)|: x € [a, d]}. 


The above error estimate can also be expressed as follows: If f satisfies the 
hypothesis of the theorem, then for n € N, 


Ws M(b—a)* 1 


= 12 n2- 8) 


b 
f fla)de — Tr (f) 


In this form it is possible to determine the value of n required to guarantee 
predetermined accuracy. 
Proof. The proof of this theorem is very similar to the proof of Theorem 


6.6.3. As a consequence we leave most of the details to the exercises (Exercise 
5). The first step is to prove that for each i = 1,...,n, 


M 
<—h?. 
~ 12 


fo seoae — Zea) + sea) 


To accomplish this, consider the function 
xi—1tt t 
w= f fle)de SUF) + Flea +9) 
Li-1 


for t € [0, A]. Then g;(0) = 0 and 
gilt) =f fade — S11) + Fa) 


By computing gi(t) and gi/(t) one obtains from the hypothesis on f that 
|gi/(t)| < tM. Since g;(0) = g/(0) = 0, applying the fundamental theorem 
of calculus twice we obtain as in Theorem 6.6.3 that |g;(h)| < 7 Mh?. The 
remainder of the proof is identical to Theorem 6.6.3. 
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Simpson’s Rule 


The trapezoidal approximation T,,(f) amounts to approximating the func- 
tion f with a piecewise linear function gp that passes through the points 
{(x;, f(v;))}, ¢ = 0,...,n. Our intuition should convince us that one way to 
obtain a better approximation to the integral of f over [{a, 6] is to use smoother 
curves. This is exactly what is done in Simpson’s rule which uses parabolas 
to approximate the integral. To use quadratic approximations we will need to 
use three successive points of the partition of [a,b]. This is due to the fact 
that three points are required to uniquely determine a parabola. 


Prior to deriving Simpson’s rule, we first establish the following formula: 


If p(x) = Ax? + Bx +C is the quadratic function passing through the points 
(0, Yo): (h, Yi); (2h, Yo), then 


2h h 
J rloide = Fluo +4 +l (24) 
0 


One way to derive this formula would be to first determine the coefficients 
A, B,C so that p(0) = yo, p(h) = yi, p(2h) = yo, and then integrate p(x). 
This however is not necessary. By integrating first, 


[oe dx A ony | B on)? + C'(2h) 
f p D 


I 


h 
ar [SAh? + 6Bh + 6C] 
h 
3 


Let f € Ria, b] and let n € N be even. Set h = (b—a)/n. On each of the 
intervals [a + 2(¢ — 1)h,a+ 2th], 1 = 1,...,n/2, we approximate the integral of 
f by the integral of the quadratic function that agrees with f at the points 


(p(0) + 4p(h) + p(2K)] = Flyo + Ay +] 


I 


Yo = fla+2@—-1)h), w=fla+ (1h), yo= f(a+ 2h). 


By identity (24) this gives 


5 [f(a+2(i — 1h) +4 f(a4t (22 — 1h) + f(a + 2th)| 
as an approximation to the integral of f over the interval [a+2(i—1)h, a+2ih]. 
Summing these terms from i = 1 to n/2 gives 


Se(fy= Pras afta +h) +2f(a+2h)+ 


3 
FAf(a+3h)+---+4f(at (n— 1h) + f(d)] 


as an approximation to the integral of f over [a,b]. The quantity S,,(f) is 
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called the nth Simpson approximation to the integral of f over [a, b]. If we 
set y; = f(a+th), then S,(f) is given by 


h 
Sn(f) = 3 yo + 4m + 2yo + 4y3 +--+ + 2Yyn—2 + 4yn—1 + Yn]- (25) 


The following theorem, again under suitable restrictions on f, provides an 
error estimate for Simpsons’s rule. 


THEOREM 6.6.5 If f is four times differentiable on [a,b] and f(x) is 
bounded on [a,b], then for n € N even, 


Z M(b—a) 


b 
[ sear - 85()] < SEO 


where M = sup{|f(a)| : 2 € [a, b]}. 


Remarks. Since the error term involves h*, Simpson’s rule is a fourth order 
method. Also, if f(a) is a polynomial of degree less than or equal to 3, then 
f(x) = 0 and thus 


b 
[ feyar= 5,08) 


If f satisfies the hypothesis of the theorem and n € N is even, then the above 
error estimate can be expressed as 


b 
J foae— sii) < “SSS. (26) 


= 180 = n4 


Proof. The proof of the theorem proceeds in an analogous manner as the 
proofs of the previous two results. We first prove that for i = 1,...,n/2, 


M 


<—Ap> 27 
Sigg? 3 (27) 


cth h 
[fede ZU) +4f(e) + Heth) 


ih 


where c; = a + (2i — 1)h. To accomplish this, define g; on [0, h] by 


c,tt 


g(t) = [fade SIf(-) +4 Fle) + fei +0) 


iat 


To prove inequality (27), we are required to show that |g;(h)| < Mh°/90. 
Upon computing the successive derivatives of g; we obtain 


HO) = Si-O + F(a+ 01+ sla) +S +0) 5 fl), 
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By the mean value theorem f’”(c; — t) — f’”"(c; + t) = f(0)(2t) for some 
¢ € (c; —t,c¢; +t). Therefore 


2 
Ig" ®)| < ge’. 


As in the previous two theorems, since g;(0) = g/(0) = g//(0) = 0, upon three 
integrations we have |g;(h)| < Mh°/90. This proves inequality (27). Finally, 


n/2 n/2 


b 
/ jae sip] = [lai] < Soa 


ae 


EXAMPLE 6.6.6 In this example, we will use the trapezoidal rule and 


Simpson’s rule with n = 8 to obtain approximations to In5. For f(x) = 271, 


f(a) = 2a-8 and f(x) = 242-5. Therefore 
sup{|f”(x)|: 2 €[1,5]}=2 and sup{|f(x)| :@ € [1,5]} = 24. 
By Theorem 6.6.4 with h = 1/2, the error Eg in the trapezoidal approximation 


satisfies 


TE aa i 
|Es(f)| < = (5) ee 0.16666.. 


On the other hand, the error Eg in using Simpson’s rule is guaranteed to 
satisfy 


4 
24-4 1 1 
< = = 0. es 
IEA) < 5 (5) 3p = 0.03333 


which is considerably better. 
With Li 1+ th and Yi = f(x), = 0, 1, oeey 8, 


2 1 2 1 2 1 2 1 
Yo 1, 1 3° Y2 2° ¥3 5» ¥4 3 Y5 7 Y6 a> Y7 9° ¥8 5° 


Therefore, 
1 7 
Ta(f) = 7 yo+ 2S oui t+ys 
i=1 
1 4 4 2 4 1 4 #1 
Ste 41d aoe 
4 3 5 38 %T 2 9 5 


= 1.6290 (to four decimal places). 
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Since In5 = 1.6094 to four decimal places, the error is less than 0.02, well 
within the tolerance predicted by the theory. With Simpson’s rule, 


1 
Sg(f) = = [yo + 4y1 + 2y2 + 4y3 + 2y4 + 4y5 + 2y6 + 4y7 + Yo] 


6 
eer ee ea ek ee ee eee 
rs eRe aes cs A A, a 


= 1.6108 (to four decimal places). 


With Simpson’s rule the actual error is less than 0.0014. 


We can also use the results of the theory to determine how large n must be 
chosen to guarantee predetermined accuracy. For the trapezoidal rule, since 
M =2 and (b— a) =4, by inequality (23) 


2.48 1 
12 n?° 


[En(f)| S 


Thus to obtain accuracy to within 0.001 we need 


.43 


4 
2 10° = 10666.66.. 


n> 


which is accomplished with n > 104. On the other hand, using Simpson’s rule, 


24-4° 1 


Ens So. 


Thus to obtain accuracy to within 0.001, we need n € N even with 


This will be satisfied with n > 20. 


Exercises 6.6 


1. a. Use the midpoint rule, trapezoidal rule, and Simpson’s rule to ap- 
2 
proximate n2 = f(1/x)da with n = 4. For each method, determine 


1 
the estimated error and compare your answer to In2 = 0.69315 (to five 
decimal places). 

b. Repeat (a) with n = 8. 

c. For each of the three methods (midpoint rule, trapezoidal rule, Simp- 


son’s rule) determine how large n must be chosen to assure accuracy in 
the approximation of In 2 to within 0.0001. 
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2. *a. Using the fact that 


' dt _t 
9 1+t 4’ 


use the midpoint rule, trapezoidal rule, and Simpson’s rule to approxi- 
mate 7/4 with n = 4. For each method, determine the estimated error. 


b. Repeat (a) with n = 8. 


c. For each of the three methods determine how large n must be chosen 
to obtain an approximation of 7 to within 0.0001. 


3. Use Simpson’s rule to obtain approximations of each of the following 
integrals accurate to at least four decimal places. 
1 2 1 
1 
a. | —— dx wow V1+a2 dx c. | sin(x”) dx. 
o 1+<a* 0 0 
4. How large must n be chosen so that the trapezoidal approximation T;, 
a2 


2 
approximates f e-” with an error less than 10°. 


ty) 
Fill in the details of the proof of Theorem 6.6.4. 


Let f be a differentiable function on [a,b] with f’(x) bounded on [a, bj. 
Let n € N. Prove that 


f(x)dz —h De f(a+ih) 


where h = (b—a)/n and M = sup{|f'(z)| : x € [a, bj}. 
7. a. Show that Ton(f) = 4[Mn(f) + Tr (f)). 
b. Show that San(f) = 2Mn(f) + 4Tn(f). 


8. Prove the following variation of Theorem 6.6.4: If f is twice differentiable 
on [a,b] and f” is continuous on [a,b], then there exists a point c € [a,b] 
such that 


M(b— a) 


< ——h 
‘Sax 9) ’ 


Tif) = [fax = PO (0), 


1 1 
. a. th i ise to show that —— < Tg — In2 < —. 
9. a. Use the previous exercise to show tha 3072 < Tg —In2< 384 


b. Using (a) and Exercise 1(b) show that .6915 < In2 < .6938. 


6.7 Proof of Lebesgue’s Theorem 


In this final section, we present a self-contained proof of Lebesgue’s charac- 
terization of the Riemann integrable functions on [a,b]. Recall that a subset 
F of R has measure zero if for any € > 0, there exists a finite or countable 
collection {J,,} of open intervals with E C U,, In and 0, Un) < €, where 
€(I,) denotes the length of the interval [,,. We begin with several preparatory 
lemmas. 
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LEMMA 6.7.1 A finite or countable union of sets of measure zero has mea- 
sure Zero. 


Proof. We will prove the lemma for the case of a countable sets of measure 
zero. The result for a finite union is an immediate consequence. 

Suppose {E,}nen is a countable collection of sets of measure zero. Set 
E =U, En and let € > 0 be given. Since each set E,, is a set of measure 
zero, for each n € N there exists a finite or countable collection {In,,}% of 
open intervals such that En, CU, Inn and >, €(In,n) < €/2*. Since we can 
always take I;,,, to be the empty set, there is no loss of generality in assuming 
that the collection {Z,,}% is countable. Then {In,~}n,x is again a countable 
collection of open intervals with EC ee Tn: 

Since N x N is countable, there exists a one-to-one function f from N onto 
NXN. For each m € N, set Jm = If(m. Then {Jm}men is a countable collection 
of open intervals with E C U,,, Jm. Since f is one-to-one, for each N € N, the 
set Fy = f({1,...,N}) is a finite subset of N x N. Hence there exists positive 
integers N; and Ky such that for all (n,k) € Fy we have 1 <n < N; and 
1<k< K,. Hence 


N 
m=1 (n,k)EFn  GRIDEN: x Ky 
But 
M Ky oe) 
Tins) = SS Mn) S329 laa) < Dok <e 
eee n=1k=1 n=1k=1 


Thus = L(Jm) <¢. Therefore E has measure zero. 


m=1 
LEMMA 6.7.2 Suppose f is a nonnegative Riemann integrable function on 
b 
[a,b] with [ f =0. Then {a € [a,b] : f(x) > 0} has measure zero. 


Proof. We first prove that for each c > 0, the set E, = {x € [a,b] : f(x) > c} 
b 
has measure zero. Let € > 0 be given. Since f f = 0, there exists a partition 


P ={2x0,21,---,Ln} of [a,b] with U(P, f) < ce, where 


i=1 
and M; = sup{ f(x) : x € [a;_1, a;]}. Let 1 = {t: E.N[x;_1, 2] 4 O}. If € J, 
then M; > c. Hence 


ce >U(P,f)> S> Mj Ac; > cy Ag;. 


4El 7EL 
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Thus ie, €([zi-1, 21]) = ie Adi < €. Finally, since FE C V [zi-1, 2%], it 
i€l 
follows that EL, has measure zero. 
To conclude the proof we note that {@ € [a,b] : f(z) > 0} = Unen En, 


where for each n € N, 


B,= {26 abe fays =}. 


by the above each E,, has measure zero. Thus by Lemma 6.7.1, the set E’ has 
measure zero. 


DEFINITION 6.7.3 Jf E is a subset of R, the characteristic function of 
E, denoted x,,, 1s the function defined by 


(x) 1, reek, 
3s 
Ae 0, c¢ EF. 


As in Section 6.2, if P = {xo,21,...,%n} is a partition of [a, b], the norm 
||P|| of the partition P is defined by ||P|| = max Ag;. If f is a bounded 


function on [a,b], we denote by m; and M; the infimum and supremum re- 
spectively of f on [x;-1,2;]. The lower function L; and upper function 
Uy for f and the partition P are defined respectively by 


Ly(z) - ‘> MiX tw, _1,24) (x), and 
i=l 


U(x) = os Mixte;_4.2) (x). 
i=1 
The graphs of the lower function Ly and upper function Uy are depicted in 
Figure 6.10. Since m; < f(x) < M; for all x € [x;_-1, 24), 
L(x) < f(a) < U-(ax) for all x € [a, b). 


Also, since Ly and Uy are continuous except at a finite number of points, 
they are Riemann integrable on [a,b] (Exercise 1) with 


b b 
[ u=L0P and [ ur=ue.s. 


THEOREM 6.7.4 (Lebesgue) A bounded real valued function f on [a,b] 
is Riemann integrable on [a,b] if and only if the set of discontinuities of f has 
measure Zero. 
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FIGURE 6.10 
Graphs of the lower and upper function of f 


Proof. Assume first that f is Riemann integrable on [a,b]. Then for each 
n € N there exists a partition P,, of [a,b] with ||P,|| <1/n, such that 


b b 
o< | f= LPatl<= and 0<U(Pr.f)— f fae (28) 


Since L(Pn, f) < L(P, f) and U(P, f) < U(Prn, f) for any refinement P of Pn, 
the partitions P,, n = 1,2,... can be chosen so that P,p+1 is a refinement of 
Pn: 


For each n € N, let LZ, and U, respectively denote the lower and upper 
functions of f for the partition P,. Then L,(x) < f(x) < Un(a) for all 
x € [a,b] and 


b b 
[in =LP uf) and [ Un =UPrf (29) 


Since P;,+41 is a refinement of P,, the functions L, and U,, satisfy L,(ax) < 
En4i(x) and Un41(@) < Un(x) for all x € [a,b]. Define the function ZL and U 
on [a, b] by 


L(x) = lim L,(@) and U(x) = lim U,(2). 


n—->co n—- Co 


Then 
L,(x) < L(x) < f(x) < U(x) < Un (2) 


for all x € [a,b]. Hence 


b b pb b b a) b 
fmsfusfusf[tsfusfus fo, 
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But by equations (28) and (29), 


b b b 
lim Ly = lim / Un ay f. 
noo a noo a a 


Hence LE and U are Riemann integrable on [a,b] with 


ae i 


Since U(x) — L(x) > 0 for all x € [a,b], by Lemma 6.7.2, {x € [a,b] : U(x) 4 
L(x)} has measure zero. Furthermore, since each P,, has measure zero, by 
Lemma 6.7.1, the set 


E = {x € [a,0]: +10) U (Urs) 


also has measure zero. We conclude by showing that f is continuous on |a, }] \ 
E. 

Fix x € [a,6] \ E, and let « > 0 be given. Since L(x.) = U(a,), there 
exists an integer k € N such that Uz(x.) — Lp(ao) < €. Also, since 1 ¢ Pr, 
the functions U; and Lx are constant in a neighborhood of x. Hence there 
exists a 6 > 0 such that 


0 < Uxg(ao) — Lp(a) = Up(x) — Dg (ao) < € 


for all x € [a, b] with |x — x,| < 6. Finally, since LZ, (a) < f(x) < U;,(x) for all 
x € [a,), 


—e < Ly (x) — Up (ao) < f(x) — f(ao) < Up(x) — Lp (Xo) < € 


for all x with |x — x,| < 6. Therefore f is continuous at 2o. 


Conversely, suppose f is continuous on [a, b]\ £7, where EF is a set of measure 
zero and a < b. Let M > 0 be such that |f(a)| < M for all x € [a, ], and let 
€ > 0 be given. Since & has measure zero, there exists a finite or countable 
collection {J,,} of open intervals such that E C U,, In and )0,, €Un) < €/4M. 
Also, since f is continuous on [a,}] \ E, for each x € [a,b] there exists an 
open interval J, such that | f(z) — f(y)| < €/2(b— a) for all y, z € Jz A [a, 6). 
The collection {I,} U {Jz : « € [a,b] \ E} is an open cover of [a,b]. Thus by 
compactness, a finite number, say {J,}7_, and {J,,}/, also cover [a,b]. Let 


P ={a=to,t,...,tw = bd} 


be the partition of [a, b] determined by those endpoints of I,,k = 1,...,n, and 
Jr,,j =1,...,m, that are in [a, b). For each j,1 < j < N, the interval (¢;—1, t;) 
is contained in some J, or Jz,. Let J = {j : (tj-1,t;) C Ip for some k}. Also, 
for each j € {1,...,N}, let m; and M; denote the infimum and supremum of 
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f on [t;-1, tj] respectively. Then M; —m, < 2M for all j € J, and M; —m,; < 
€/2(b—a) for all j ¢ J. Thus 


U(P, f) — L(P, f) = > (My — mj) At; + 50 (M; — m;)At; 
jet jE¢I 


Hence by Theorem 6.1.7 the function f is Riemann integrable on [a, }]. 


Exercises 6.7 


1. Let f be a real-valued function on [a,b] and P a partition of [a, b]. Prove 
that the lower function Ly and upper function U; for the partition P are 
Riemann integrable on [a, b] with 


b b 
fer=c@en ma fo us=ues. 

2. *Let P be that Cantor set in [0,1]. Show that y, € R/[0,1] and find 
Jo Xp (w)da. 

3. Let f € R{a,b], and for x € [a,b], set F(x) = f f(t)dt. Prove that there 


exists a subset F of [a,b] of measure zero such that F’(x) = f(z) for all 
x € [a,b] \ E, 


4. *Suppose f € Ra, b] and g is a bounded real-valued function on |[a, }]. If 
{x € [a,b] : g(x) # f(x)} has measure zero, is g Riemann integrable on 
[a, b]? 


Notes 


The fundamental theorem of calculus is without question the key theorem of cal- 
culus; it relates the Cauchy-Riemann theory of integration with differentiation. For 
Newton, Leibniz, and their successors, integration was the inverse operation of differ- 
entiation. When Cauchy however defined integration independent of differentiation, 
the fundamental theorem of calculus became a necessity. It was crucial in proving 
that Cauchy’s integral was the inverse of differentiation, thereby providing both a 
convenient tool for the evaluation of definite integrals and proving that every con- 
tinuous real-valued function defined on an interval J has an antiderivative on J. 
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Although we stated the fundamental theorem of calculus as two separate theo- 
rems, for continuous functions they are the same. Specifically, if f is a continuous 
real-valued function on [a,b] and F is an antiderivative of f, then for any x € [a, 6], 


F(a) =F(a)+ [fear 


Conversely, if f is continuous and F is defined as above, then F’(x) = f(z). 

Lebesgue’s theorem is one of the most beautiful results of analysis. It pro- 
vides very concise necessary and sufficient conditions for Riemann integrability of 
a bounded real-valued function f. Although Riemann was the first to provide such 
conditions, his result lacked the simplicity and elegance of Lebesgue’s theorem. Un- 
fortunately for Riemann, the concept of measure had not yet been developed when 
he stated and proved his result. In Chapter 10 we will develop the theory of measure 
and Lebesgue’s extension of the Riemann integral. 

The need for numerical methods for the evaluation of definite integrals was rec- 
ognized as early as the eighteenth century. Euler and Thomas Simpson (1710-1761), 
among others, used numerical techniques to approximate the definite integral in 
problems where an antiderivative could not be found. Even the error estimates devel- 
oped in Section 6 date back to that era. With the availability of efficient calculators 
and high speed computers, numerical methods have increased in importance in the 
past few decades. This has led to the development of very sophisticated numerical 
algorithms for the evaluation of definite integrals. 

Although Newton and Leibniz are credited with inventing the differential and 
integral calculus, many mathematicians prior to their time knew formulas for com- 
puting tangents and areas in particular instances. Archimedes (around 200 B.C.) in 
his treatise Quadrature of the Parabola used the method of exhaustion by inscribed 
triangles to derive a formula for the area under a parabolic segment. By the mid 
1640’s, Pierre de Fermat (1601-1665) had determined the formulas for the area un- 
der any curve of the form y = x” (k # —1), and for finding tangents to such curves. 
Issac Barrow (1630-1677), who was a professor of geometry at Cambridge, in his 
1670 treatise Lectiones geometriae developed an algebraic procedure which is virtu- 
ally identical to the differential calculus for finding tangents to a curve. However, 
all these early methods were developed using geometric arguments. Newton and 
Leibniz developed the concepts, the notation, and the algorithms for making these 
computations for arbitrary functions. Most importantly however, both men realized 
the inverse nature of the problems of tangents and areas. For these reasons they 
are credited with the development of the differential and integral calculus. Further 
information on the historical development of calculus may be found in the text by 
Katz listed in the Bibliography and the article by Rosenthal listed at the end of the 
chapter. 


Miscellaneous Exercises 


A real-valued function f on [a,b] is a step function if there exist a finite number 
of disjoint intervals {;}_1 with Ul; = [a,b] such that f is constant on each of the 
intervals Jj, 7 =1,...,n. 


298 Introduction to Real Analysis 


1. a. If f is a step function on [a,b], prove that f € Ria, b] with 


[r= Soe 


where c; is the value of f on Jj. 


b. If 7 € Ra, b] and € > 0 is given, prove that there exists a step function 
h on [a,b] such that 


fu- hl <e. 


c. If h is a step function on [a,b] and € > 0 is given, prove that there 
exists a continuous function g on [a, b] such that 


b 
f |h—g| <e. 


d. If f € Ria, b] and € > 0 is given, prove that there exists a continuous 
function g on [a,b] such that 


[r-si<e 


Let f be a real-valued function defined on [0,0o). The Laplace trans- 
form of f, denoted L(f), is the function defined by 


£(A\(s) = / en" F(t) dt, 


whenever the improper Riemann integral exists. 


2. Let f be defined on [0, co). Prove that there exists a € RU{—oo, oo} such 
that £(f)(s) is defined for all s € (a,oo), and that the integral defining 
L(f)(s) diverges for all s € (—oo, a). 

(Hint: First show that if £(f)(s.) exists for some s,, then L(f)(s) exists 
for all s > 85.) 

3. Suppose f € R[0,c] for every c > 0, and that there exists a positive 
constant C, and a € R, such that | f(t)| < Ce” for all t > 0. Prove that 
L(f)(s) exists for all s > a. 

4. Compute the Laplace transform of each of the following functions. In 
each case, specify the interval on which £(s) is defined. 


a. f(t) =1 

b. f(t) =e", aEeR 

c. f(t) = coswt 

d. f(t) = sinwt 

e. f(t) =t", n EN. (Use induction.) 

f. f(t) = I(t — c), where I(t — c) is the unit jump function at t =. 


g. f(t) =t*, a> —1. (See Exercise 8, Section 6.4.) 
5. Suppose f is differentiable on [0, co) and a € R is such that L(f)(s) exists 
for all s > 1. If jim e *' f(t) = 0 for all s > a, prove that L(f’)(s) = 
— 00 


sL(f)(s) — f(0). 
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Series of Real Numbers 


Although the study of series has a long history in mathematics,' the modern 
definition of convergence dates back only to the beginning of the nineteenth 
century. In 1821, Cauchy, in his text Cours d’Analyse, used his definition of 
limit to provide the first formal definition of convergence of a series in terms 
of convergence of the sequence of partial sums. The Cauchy criterion (Theo- 
rem 3.7.3) was the first significant result to provide necessary and sufficient 
conditions for convergence of a series. Cauchy not only stated and proved the 
result, he also applied his result to prove convergence and divergence of given 
series. Many of the early convergence tests, such as the root and ratio test, are 
due to him. Cauchy, with his formal development of series, placed the subject 
matter on a rigorous mathematical foundation. 

In this chapter, we will continue our study of series of real numbers begun 
earlier in the text. Our primary emphasis in Section 7.1 will be on deriving 
several tests that are useful in determining the convergence or divergence of a 
given series. In Section 7.3 we will study the concepts of absolute convergence, 
conditional convergence, and rearrangements of series. One of the key results 
of this section is that every rearrangement of an absolutely convergent series 
not only converges, but converges to the same sum. As we will also see, this 
fails dramatically if the series converges but fails to converge absolutely. 

In Section 7.4 we give a brief introduction to the topic of square summable 
sequences. These play an important role in the study of Fourier series. One 
of the main result of this section will be the Cauchy-Schwarz inequality for 
series. This section also contains a brief introduction to normed linear spaces. 


7.1 Convergence Tests 


In Section 3.7, we provided a very brief introduction to the subject of infinite 
series. In the study of infinite series, it is very useful to have tests available by 
means of which one is able to determine whether a given series converges or 
diverges. For example, Corollary 3.7.5 is very useful in determining divergence 
of a series. If the sequence {a,} does not converge to zero, then the series 


1See the notes at the end of the chapter. 
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>> ay diverges. On the other hand however, if lima, = 0, then nothing can 
be ascertained concerning convergence or divergence of the series 5+ a,. In 
this section, we will state and prove several useful results that can be used 
to establish convergence or divergence of a given series. Additional tests for 
convergence will also be given in the exercises and subsequent sections. With 
the exception of Theorem 7.1.1, all of our results in this section will be stated 
for series of nonnegative terms. 
co 
As in Definition 3.7.1, given an infinite series 5~ a, of real numbers, 
k=1 
{s,}°2, will denote the associated sequence of partial sums defined by 


n 
Sn = ) Qk: 
b=1 


The series }> a, converges if and only if the sequence {s,} of nth partial 
sums converges. Furthermore, if lim s, = s, (s € R), then s is called the 
n—->oco 


sum of the series, and we write 


Co 
) ak = S. 
k=1 


If the sequence {s,,} diverges, then the series 5+ a, is said to diverge. Fur- 
thermore, if lim s,, = oo (or —oo), then we write }> a, = 00 (—0«) to denote 
n—->co 


that the series diverges to oo (or —ov). 
If ax, > 0 for all k, then by Theorem 3.7.6 > a, converges if and only if 


lim s,, < oo. Thus for series of nonnegative terms we adopt the notation 
n—->co 


co 
) Ak <c 
k=1 


to denote that the series converges. 


Remarks. (a) Although we generally index a series by the positive integers 
N, it is sometimes more convenient to start with k = 0 or with k = k, for 
some integer k,. In this case, the resulting series are denoted as 


oo oo 
; Qk; ) Qk. 
k=0 k=ko 


Also, from the Cauchy criterion (Theorem 3.7.3) it is clear that }* a, con- 
k=1 


co 
verges if and only if > a, converges for some, and hence every, k, € N. 
k=ko 
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(b) Given any sequence {s,,}°2, of real numbers we can always find a series 


>> ax whose nth partial sum is s,,. If we set a; = 51 and ay = 8,—Sp-1, k > 1, 
then 


n 
Say = 81 + (82 — 81) +--+ + (Sn — Sn—1) = Sn. 
k=1 


THEOREM 7.1.1 Jf >> a, =a and >> by = B, then 
k=1 k=1 
(a) }> ca, =ca, for anycER, and 
k=1 
(b) So (az + bk) = a+ B. 
k=1 


Proof. The proof of (a) is similar to (b) and thus is omitted. To prove (b), 
for each n €N, let 


sn = do ag and Se 
k=1 


Since the series converge to a and ( respectively, lim s, = @ and limt, = 6. 
Therefore by Theorem 3.2.1, lim(sp + tn) = a+ 8. But 


n 


n n 
Sn ttn = > ant >— be = > (an +d). 
k=1 k=1 


k=1 


Therefore s, + ty is the nth partial sum of the series 5>(a, + bx). Since the 
sequence {s,, + t,} converges to a+ £, 


Co 


S "(ax + dx) =at+ p. 


k=1 


Comparison Test 


One of the most important convergence tests is the comparison test. Although 
very elementary, it provides one of the most useful tools in determining con- 
vergence or divergence of a series. It is useful both in applications and theory. 
Several of the proofs of subsequent theorems rely on this test. In applications, 
by comparing the terms of a given series with the terms of a series for which 
convergence or divergence is known, we are then able to determine whether 
the given series converges or diverges. 


THEOREM 7.1.2 (Comparison Test) Suppose >a, and >> by are two 
given series of nonnegative real numbers satisfying 


Os ars Mb 
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for some positive constant M and all integers k > ky, for some fixed ky € N. 


(a) If >> by < co, then SO ax < ov. 
k=1 k=1 

(b) If S> ax = 00, then > by =~. 
k=1 k=1 


Proof. Suppose the terms {a,} and {b,} satisfy a, < Mb, for all k > k, and 
some positive constant M. Then for n >m > k, 


O< Ss an <M SS br. 


k=m-+1 k=m+1 


Suppose 5+ 6; converges. Then given € > 0, by the Cauchy criterion (3.7.3) 
there exists an integer n, > k, such that 


se bk < 


k=m+1 


n 
for alln >m->n,. Thus0< SY ag < « for alln > m > no, and hence 
k=m+1 
by the Cauchy criterion }* a, converges. On the other hand, if $> a, diverges, 
then 5> by, must also diverge. 


As a corollary of the previous theorem we also have the following version 
of the comparison test. 


COROLLARY 7.1.3 (Limit Comparison Test) Suppose )> ax, and S> by 
are two given series of positive real numbers. 
(a) Jf lim - = L with0 < L < o, then Sax converges if and only if 
noo n 
So by converges. 


(b) Jf lim = = 0 and )> by converges, then Y~ ax, converges. 
noo n 


Proof. The proof, the details of which are left to the exercises (Exercise 6), 
follows immediately from the definition of the limit and the comparison test. 


Remark. If lim a/b, = 0 and S> a, converges, then nothing can be con- 
noo 


cluded about the convergence of the series 5° by. In Example 7.1.4(d), we 

provide an example of a divergent series }~ b; and a convergent series )* ay 

for which lim a,/b, = 0. On the other hand, in Exercise 23, given a con- 
noo 


vergent series }> a, with a, > 0, you will be asked to construct a convergent 
series )* b, with by > 0 such that lim a,/b, = 0. 
noo 
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EXAMPLES 7.1.4 (a) As an application of the comparison test consider 
the series 


We will compare the given series with the convergent geometric series 
> (1/2)*. Thus we wish to show that there exists k, € N such that k/3* < 
1/2* for all k > ko. Since 2/3 < 1, by Theorem 3.2.6(d) 


k 
: 2 
ine (5) =v 


Thus by taking « = 1, there exists an integer k, such that k(2/3)* < 1 for all 
k > ko. As a consequence, 
k 1 
ney < os 


3h S oR for all k> ko. 


Since )*>(1/2)* < 00, by the comparison test the given series also converges. A 
similar argument can be used to prove that 5+ k” i a® converges for any n € Z 
and a € R with a > 1 (Exercise 2(1)). This is accomplished by comparing the 
given series with > b-*, where 1 <b <a. 


(b) As our second example consider the series 


In order to use the comparison test we have to determine what series we want 
to compare with. Since 


eal f: ieee 1+H 
a = ‘ and = lim é =5 2; 
2k3>4+1 =#«-&k 2+ ps k-y00 V 2+ z5 


we will compare the given series with the series }*1/k. This series is known 
to diverge (Example 3.7.4). If we take « = +./2, then we can conclude that 
there exists k, € N such that 


1+¢ ~ 
> $V2—-€=4Vv2 
Vora 22 ae 


for all k > k,. Thus there exists a positive constant M and k, € N such that 


k+1 1 
Fe tare = 
W+1— k 


for all k > k,, and as a consequence, the given series diverges. 
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(c) The divergence of the series 2» wo 


limit comparison test. Comparing the terms of the given series to the terms 
of the series }> 1/k we have 


k+1 
2k3+1 

1 

k 


Thus since the series > 1/k diverges, by the limit comparison test the series 


oo k+1 
—z——~ also diverges. 
» Vaea1 iverg’ 


(d) Let a, = 2~* and by = 1/k. Then >> ax converges, )~ by diverges, and 


can also be obtained by the 


= lim = 


li ve 
vs k-00 ie oe 2 


k— oo 


a . : 
Thus if lim - = 0, convergence of the series > a, does not imply conver- 
n—-Co 


gence of the series 7 bx. 


Integral Test 


Our second major convergence test is the integral test. Recall from Section 
6.4, if f is a real-valued function defined on [a,oo) with f € R[a,c] for every 
c >a, then the improper Riemann integral of f is defined by 


[ teoyae= tim f° pe) ae, 


provided the limit exists. If f(a) > 0, we use the notation 


[ fear <co (or [- Haz =~) 


to denote that the improper integral of f converges (diverges). 


THEOREM 7.1.5 (Integral Test) Let {a,}?2, be a decreasing sequence 
of nonnegative real numbers, and let f be a nonnegative monotone decreasing 
function on [1,00) satisfying f(k) =a, for allk € N. Then 


S- ap < Co if and only if | f(a) dx < o. 
k=1 ss 


Proof. Since f is monotone on [1,00), by Theorem 6.1.8 it is Riemann inte- 
grable on [1,c] for every c > 1. Let n € N, n > 2, and consider the partition 
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FIGURE 7.1 
Integral test 


P = {1,2,...,n} of [1,n]. Since f is decreasing, for each k = 2,3,...,n, (see 
Figure 7.1) 


sup{f(t):t€ [k—1,k]}=f(K—-1)=ae-1, and 
inf{ f(t): t€ [k—1,k]} = f(k) = ak. 


Therefore 


me n n-1 
San =ctP.f)< fo fle)ae sur.) = Yan, 
k=2 1 k=1 


from which the result now follows. 


EXAMPLES 7.1.6 (a) As our first application of the integral test we con- 


sider the p-series 
co 
1 
Ue 
k=1 


When p = 1 this series is referred to as the harmonic series. If p < 0, 
then {k~?} does not converge to zero, and thus by Corollary 3.7.5 the series 
diverges. Suppose p > 0, p #1. Let f(x) = x7? , which is decreasing on [1, 00). 


Then i 
a 1 
i: a Pdx = —— |/1- : 
1 pol cpt 


lee) ec —., > 1, 
| x ?dx = lim x Pdx =< p—1 » 
1 


coo 1 


Therefore, 
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Thus by the integral test the series diverges for p < 1 and converges for p > 1. 
When p = 1, then by Example 6.3.5, 


aa | 
i —dx = lnc. 
1 x 


Since lim Inz = — lim Int = oo (Example 6.4.2(a)), by the integral test the 
LOO t—0+ 


series also diverges for p = 1. Summarizing our results we find 


kp diverges, if p<. 


Se 1 converges, if p>1, 
k=1 


(b) As our second application of the integral test we consider the series 


Let f(x) = (xIna)~!, x € [2,00). Since 


(1+Inz) 
(clnx)? ’ 


f(z) =- 


f'(x) < 0 for all x > 1. Thus f is monotone decreasing on [2, 00). But 


cd 
lim ‘) dx = lim In(Inc) — In(In2) = oo. 
c00 Jo elnx coo 


Thus by the integral test the given series diverges. 


(c) As our final example, we consider the series 


Ink 


kp’ 
k=2 


pER. 


We first consider the case p = 1. Since f(x) = (Inx)/a is decreasing on [e, 00) 
and 


al 
lim a? de = lim (Inc)? — 1 = 00, 
c+00 J, L c— 00 


by the integral test the series )>7°.,(Ink)/k diverges. 
Suppose now that p > 1. Write p = q+r, where g > 1 andr > 0. 
By lV’Hospital’s rule, lim (Inz)/x” = 0. Thus there exists k, € N such that 
«LOCO 


(Ink)/k” < 1 for all k > k,. As a consequence 


Ink _ 1 Ink 1 
kp ka kr — ea 


for all k > ko. Since q > 1 the series }> 1/k% converges. Hence by the compar- 
ison test the series )>(Ink)/k? also converges when p > 1. 
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Finally, if p < 1, then again the divergence of }°1/k? implies that 
So (Ink)/k? also diverges. This follows from the fact that (Ink)/k? > (In2)/k? 
for allk € N, k > 2. Summarizing our results we find 


ss Ink converges, ifp>1, 
pace diverges, ifp <1. 


Root and Ratio Test 


We now consider the well known root and ratio tests. Although useful in 
determining the convergence or divergence of certain types of series, both of 
these tests are also very important in the study of power series. The ratio 
test, attributed to Jean d’Alembert (1717-1783), is particularly applicable to 
series involving factorials. The root test, due to Cauchy, will be used in the 
next chapter to define the interval of convergence of a power series. Because 
of the close similarity between these two tests we state them together. 


Prior to stating the ratio and root tests, we recall the definition of the limit 
inferior and limit superior of a sequence of real numbers (Definition 3.5.1) If 
{s,} is a sequence in R, then 


lim s, = supinf{s, :n >k} = lim inf{s,:n> k}, and 
n—0o keEN k—400 


Jim Sn = inf sup{sn in>kb= iim sup{s, :n > k}. 


By Theorem 3.5.7, If E denotes the set of subsequential limits of {s,,} in 
RU {-co, co}, then 


lim s, = inf E and lim s, = sup LE. 
noo noo 


In particular, if the sequence {s,} converges (or diverges to either —oo or 00), 
then lim s,, = lims, = lims,. 


THEOREM 7.1.7 (Ratio Test) Let S\a, be a series of positive terms, 


and let os ji 
7. 4k+1 ‘ k+1 
R= lim —+ , and r= lim —, 
k-+00 Ak k>00 Ok 


(a) If R <1, then Y> ay < ow. 
k=1 


(b) Ifr > 1, then S> ax =o. 
k=1 


(c) [fr <1< R, then the test is inconclusive. 


310 Introduction to Real Analysis 


THEOREM 7.1.8 (Root Test) Let }> a, be a series of nonnegative terms, 
and let = 
a= lim ~/ag. 
k-00 


(a) Ifa <1, then SO ax < oo. 
k=1 


(b) Ifa> 1, then > ay =o. 
k=1 
(c) Ifa =1, then the test is inconclusive. 


Before proving the theorems we give several examples that illustrate these 
two convergence tests. 


OI, 
EXAMPLES 7.1.9 (a) Consider the p-series 5> i for p > 0. For this 
k=1 


series, 

r=R=ae=l1 
for any p > 0; thus both tests are inconclusive. The series however diverges if 
0 <p<1and converges for p > 1. 


(b) As our second example we consider 


oO ok 
a ae 0<p<o. 
k=1 ~ 
Here a, = p*/k!. Thus 
lim 2e+2 ee sel : 
— OC im -—-—_- = 


By the ratio test the series converges for all p, 0 < p < ow. In this example, 
the presence of k! makes the root test difficult to use. 


(c) Consider $> a, where 


if n = 2k, 
dn = 


ifn=2k+1. 


Here 
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By computation, 


k 
mh 1 
. ; (3) AOR 


For the subsequence of {@n+41/an} with even n, 


a oy 
lim 2 — lim (3) =0. 
k->co Q2k k>00 \ 3 


For the subsequence with odd n, 


k 
: Q2k4+2 ; 
lim = 5 lim = OOo. 
k-00 A2k4+1 k-00 \2 


Thus {0,00} is the set of sub-sequential limits of {a,+41/a,}. Consequently, 
r =O and R=oo. Therefore the ratio test is inconclusive. On the other hand 


1 
—, n= 2k 


/ 2 
an V2 


By Theorem 3.2.6(b), jim (/3)1/(2k+)) — 1. Thus the sequence { x/a;} has 
00 


two sub-sequential limits; namely 1//2 and 1/V/3. Therefore a = 1/2, and 
the series converges by the root test. 


>) 


Proof of Ratio Test. Suppose 


Tm 2 = R <1. 
an 

Choose c such that R < c < 1. Then by Theorem 3.5.3(a) there exists a 

positive integer n. such that 


An+1 
an 


<ec for all n> no. 


In particular, a@,,41 < ¢adp,. By induction on m, @n,4m < ¢c'Gn,. Therefore, 
writing n= no +m, m > 0, 


Qn < Mc” for all n> no, 


where M = a,,,/c"°. Thus since 0 < c < 1, by Example 3.7.2(a) the series 
>> c” converges. Therefore )* a, also converges by the comparison test. 
Suppose 


=r 1, 


312 Introduction to Real Analysis 


Again choose c so that r > c > 1. As above, there exists a positive integer no 
such that a, > Mc” for some constant M and all n > no. But since c > 1, 
>> c” = ov, and thus by the comparison test, S> an = co. 
Proof of Root Test. Let 


= lim 2a,. 


n—->co 


Suppose a@ < 1. Choose c so that a < c < 1. Again by Theorem 3.5.3 there 
exists a positive integer n, such that 


an <€ for all n> no. 


But then a, <c” for all n > no, and > ay < oo by the comparison test. 
Ifa > 1, then %/a, > 1 for infinitely many n. Thus a, > 1 for infinitely 

many n, and as a consequence {a,} does not converge to zero. Hence by 

Corollary 3.7.5 the series }> ay, diverges. 


Example 7.1.9(c) provides an example of a series for which the ratio test 
is inconclusive, but the root test worked. Thus it appears that the root test is 
a stronger test, a fact which is confirmed by the following theorem. 


THEOREM 7.1.10 Let {a,,} be a sequence of positive numbers. Then 


a Gh . a —— @ 
lim —t' < lim Yan < lim w/a, < lim ey 
noo 


noo Gn noo n7co An 


Remark. As a consequence of the theorem, if a series }* a, converges by 
virtue of the ratio test, ie., R <1, then we also have a < 1. Similarly, if }> az 
diverges by virtue of the ratio test, i.e., r > 1, then we also have a > 1. Thus 
if the ratio test proves convergence or divergence of the series, so does the 
root test. The converse however, as indicated above, is false. 


Proof. Let i 
R= Im 2. 


N00 On 


If R = ov, then there is nothing to prove. Thus assume that R < oo, and let 
8 > R be arbitrary. Then there exists a positive integer n, such that 


a 
—"th <6  foralln>no. 
an 


As in the proof of the ratio test, this gives a, < M 6” for all n > n,, where 
M =a,,/8"°. Hence 


Van < BVM for all n > no. 
Since lim YM =1, we have 


noo 
lim ?*/an < B. 
noo 


Since 68 > R was arbitrary, lim v/a, < R, which proves the result. The 
noo 


inequality for the limit inferior is proved similarly. 
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EXAMPLE 7.1.11 If a, = k!, then lim(a,41/a,) = oo. Thus as a conse- 


quence of the previous theorem, 


lim Wk! =o. 


k-o0o 


Exercises 7.1 


1. 


If a and 6 are positive real numbers, prove that 


co 


1 
Dak + BF 


k=1 
converges if p > 1 and diverges if p < 1. 


Test each of the following series for convergence: 


< _k eo ath ke? 
* b * oe 
a ay 2» Pe oho1 Cr DoE 
co 3 k co 3k co 3k 
d. ke *e Pon f. — 
k=1 kan ke kat ki! 
co 2 co co 
ree yaa ey i ils 
kai (2k)! kaa ke k=1 k 
co co 1 
Vk —1)" *k, 
’ oe . ) % (Ink)? 
1 y Ta>ined *m. S> sin(1/k?), p > 0 
k=1 1 


k= 
cos(1/k?),p>0 *o. >> 


5 
iMe 
cow 
I 

aT) Re 
=F 

—~ 
ee 

+ 

| 
NY, 


For each of the following, determine all values of p € R for which the 
given geometric series converges, and find the sum of the series. 

co foe) co k 
aS (inp)! be (B)" eS (F22) ved 

k=0 kai \3 kao \1—p 
Suppose az > 0 for all k € N and )> ax < oo. For each of the following, 
either prove that the given series converges or provide an example for 
which the series diverges. 


a. >> b. >> a; c. >> Jak 
k=1 


kai 1+ ax k=1 
*d. >> kar e. >> Wk ar *f. SS “ 
k=1 k=1 k=1 


g. oan, where {a,,} is a subsequence of {a,} 


*Determine all values of p and q for which the following series converges: 


= 1 
> k@(In k)P 
(Hint: Consider the three cases gq > 1, g=1, ¢ < 1) 


*Prove Corollary 7.1.3. 
If S° ap converges and S~ be = 00, prove that S*(ax + be) = co. 
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8. *Suppose {a,} is a sequence in R with an > 0 for all n € N. For each 
k EN set 


1 k 
by = lm 
n=1 


Prove that )7 7°, bx diverges. 
9. Determine all values of p for which the following series converges: 
co k 

1 1 
See) 


10. Suppose that the series }> a, converges and {n,} is a strictly increasing 
sequence of positive integers. Define the sequence {b,} as follows. 


by =ar+---+4n, 


bo = Gn,41 +++++ Ang 


be = Anz_14+1 ee an, - 

Prove that )7 b; converges and that S77... bk = O72, ax. (This exercise 
proves that if the series )\ ax converges, then any series obtained from 
Soak by inserting parentheses also converges to the same sum. The fol- 
lowing exercise shows that removing parentheses may lead to difficulties.) 


co 
11. *Give an example of a series S* ax such that > (a2x-1 + Ger) con- 
k=1 
verges, but 5+ ax diverges. 


12. *Suppose that the series }\ ax of positive real numbers converges by 


co 
virtue of the root or ratio test. Show that the series }> k” ax converges 
k=1 
for alln Ee N. 
13. *Show that the series 
1 | 1 i 1 i 1 i 
127 98" 327 43 t 
converges, but that both the ratio and root tests are inconclusive. 


14. Apply the root and ratio tests to the series }> a, where 


1 

a when & is even, 
ak = 2 1 

32? when &k is odd. 


15. Suppose a, > 0 for all k € N. Prove that the series 5> a, converges if 
k=1 
and only if some subsequence {sn, } of the sequence {s,} of partial sums 


converges. 
16. *(Cauchy Condensation Test) Suppose that ai > a2 >a3>--->0. 


Use the previous exercise to prove that >> ax converges if and only if 
k=1 


co 
>> 2¥ ayn converges. 
k=0 
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17. Use the Cauchy condensation test to show that 5> (pp converges for all 
n=1 
p > 1, and diverges for all p,O<p<1. 
18. Use the Cauchy condensation test to determine the convergence or diver- 
gence of each of the following series. 
1 el = 1 
*a, b. —_———_ 1). ; ——________ 
- Ps kink a Ane oe » k(n k)(n(n f)) 
19. *For k € N let cz be defined by 
i 1 
Prove that {cz} is a monotone decreasing sequence of positive numbers 
that is bounded below. The limit c of the sequence is called Euler’s 
constant. Show that c is approximately 0.577. 
20. (Raabe’s Test) Let ax, > 0 for all k € N. Prove the following: 
a. If ax41/ax < 1—r/k for some r > 1 and all k > ko, ko € N, then 
Yo ax < 00. (Hint: Show that (k—1)ax—kag4i1 > (r—1)ay for all k > ko). 
b. If ax41/an > 1-—1/k for all k > ko, ko € N, then S> a, = oo. (Hint: 
Show that {kax+1} is monotone increasing for k > ko). 
21. *If p, q > 0, show that the series 
(p+1)(p+2)---(p+k) 
& (a+ +2): (+k) 
converges for g > p+ 1 and diverges for gq < p+1. 
22. For p > 0 consider the series 
1\? 1-3\? 1-3---(2k—1)\? 
2 2-4 2-4---(2k) 
a. Show that the ratio test fails for this series. 
b. Use Raabe’s test to show that the series converges for p > 2, diverges 
for p < 2, and that the test is inconclusive when p = 2. 
*c. Prove that the series diverges for p = 2. 
23. Let {an} be a sequence of positive real numbers. 
*a. Suppose >> an converges. Construct a convergent series 5+ b, with 
b, >O such that lim ap,/b, = 0. 
n—-oco 
b. Suppose 5“ an diverges. Construct a divergent series )> bn with 
bn > 0 such that lim bn/an = 0. 
n—>oo 
ST 


7.2. The Dirichlet Test 


In this section, we prove the Dirichlet convergence test, named after Peter 
Lejeune Dirichlet (1805-1859), and then apply it to both alternating series and 
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trigonometric series. The key to the Dirichlet test is the following summation 
by parts formula of Neils Abel (1802-1829). This formula is the analogue for 
series of the integration by parts formula. 


THEOREM 7.2.1 (Abel Partial Summation Formula) Let {a,} and 
{by} be sequences of real numbers. Set 


Ap = 0 and Raia tig ifn > 1. 
k=1 


Then ifl<p<q, 


q q—1 
S- Qk by = x2 Ax (by be41) t Ag bg Ap-1 bp. 
k=p k=p 


Proof. Since az = Ap — Ag—1, 


q q 
S- ap be = So (As — Ag—1)bx 
k=p k=p 
q q-1 
= Ar by — y Ap be+t 
k=p k=p-1 
q-l 


= Ax (bx be+1) t Ag bg Ap 1 bp. 


As an application of the partial summation formula we prove the following 
theorem of Dirichlet. Another application is given in Exercise 1. 


THEOREM 7.2.2 (Dirichlet Test) Suppose {a,} and {by} are sequences 
of real numbers satisfying 


(a) the partial sums A, = > ay form a bounded sequence, 
k=1 
(b) by > by > b3 > eee > 0, and 


(c) lim by =0. 
k- 00 


[oe 
Then S~ ax by converges. 
k=1 


Proof. Since {A,,} is a bounded sequence, we can choose M > 0 such that 
|A,| < M for all n. Also, since b, — 0, given € > 0, there exists a positive 
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integer no such that b, < €/2M for all n > no. Thus, if ng < p < q, by the 
partial summation formula 


q q-1 
Sax by = S > An (bi be41) t Ag bg Ap-1 bp 
k=p 
a 
|Ax| (6x — be41) + [Ag] bg + |Ap—il bp 
= 
q-1 
<M So (be — be41) + bg + bp 
k=p 
<2M by <e. 


Hence by the Cauchy criterion (Theorem 3.7.3), 5+ a, b, converges. 
k=1 


Alternating Series 


Our first application of the Dirichlet test is to alternating series. An alter- 
nating series is a series of the form )>(—1)*b, or )>(—1)**1bz, with by > 0 
for all k. 


THEOREM 7.2.3 (Alternating Series Test) If {b,} is a sequence of real 
numbers satisfying 


(a) by > bg >--- > 0, and 
(b) lim by = 0, 
k—-00 
then > (—1)**1b,, converges. 
k=1 


Proof. Let a, = (—1)*t!. Then |A,| < 1 for all n, and the Dirichlet test 
applies. 


Remark. The hypothesis (a) that {b;} is decreasing is required. If we only 
assume that b, > 0 and jim by = 0, then the conclusion is false (Exercise 2). 
—0o 


For an alternating series satisfying the hypothesis of Theorem 7.2.3, we 
can actually do better than just prove convergence. The following theorem 
provides an estimate on the rate of convergence of the partial sums {s,,} to 
the sum of the series. 


THEOREM 7.2.4 Consider the series Se 1)**1b,, where the sequence 
{by} satisfies the hypothesis of Theorem 7. 2. 2. Let 


Sn = sy y, and $= SS (-1)** by. 
k=1 
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Then |s — 8y| < bn4i for alln EN. 


Proof. Consider the sequence {s2,,}. Since 


2n 
Son = YS (-1)**"b, = (by bz) pee eer (bon—1 bon); 
= 


k 
and (bp-1 — bg) > O for all k, the sequence {s2,,} is monotone increasing. 
Similarly {52,41} is monotone decreasing. Since {s,,} converges to s, so do 
the subsequences {s2,,} and {52,41}. Therefore sa, <8 < S9n41 for alln EN. 
As a consequence |s — s%| < |S%41 — S%| = bg+41 for all k EN. 


EXAMPLE 7.2.5 Since the sequence {1/(2k — 1)} decreases to zero, by 
Theorem 7.2.3 the series 


oo (=1)""4 
x 2k—-1 
k=1 


converges. As we will see in Chapter 9 (Example 9.5.7(a)), this series converges 
to 7/4. Thus by Theorem 7.2.4, if s,, is the nth partial sum of the series, 


T 1 
| 8n| S 
4 2n+1 


for all n € N. Although this can be used to obtain an approximation to 7, 
the convergence is very slow. We would have to take n = 50 to be guaranteed 
accuracy to two decimal places. 


Trigonometric Series 


Our next application of the Dirichlet test is to the convergence of trigonometric 
series. These types of series will be studied in much greater detail in Chapter 
9. 


THEOREM 7.2.6 (Trigonometric Series) Suppose {b;,} is a sequence of 
real numbers satisfying b1 > bg >--- >0, and jim by = 0. Then 
$00 


(a) 5> by sinkt converges for allt € R, and 
k=1 

(b) >> by coskt converges for allt € R, except perhaps t = 2pr, p € Z. 
k=1 


Proof. To prove the result, we require the following two identities: For t 4 
2pm, p € Z, 


n 1 1 
cos st — cos(n + 5 )t 
s sin kt = 2 - ( z)e (1) 
re 2 sin 5t 


n : 1 re 
sin(n + 5)t— sin st 
) cos kt = ( ; 2) i 2 (2) 
= sin xt 
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We will prove (1), leaving (2) for the exercises (Exercise 4). Set An, = = sin kt. 


Using the trigonometric identity sin A sin B = ${cos(A— B) — eye + 'B)) w 
obtain 


I 
Mis 


(sin $t) A, sin $¢ sin kt 


an 


k= 
= ; S- [cos(k — 4)t — cos(k + 3)¢] 
k 

; [cos $t — cos(n + 5)t] . 


Thus for t 4 2p7, p € Z, 


cos $t — cos(n + 4)t 


An = 7 1 ’ 
2 sin 5t 
and therefore 
Anl < | cos $t| + |cos(n + 4)t| 1 
cia 2| sin 4¢| ~ |sin 4¢|’ 


which is finite provided t 4 2pm, p € Z. Consequently, by the Dirichlet test 
the series in (a) converges for all t 4 2p7, p € Z. If t = 2pr, p € Z, then 
sin kt = 0 for all k. Thus the series in (a) converges for all t € R. 

The proof of the convergence of the series in (b) is similar. However in this 
case, when t = 2pm, coskt = 1 for all k € N and the given series may or may 
not converge. 


EXAMPLE 7.2.7 By Theorem 7.2.6, the series 


cos kt 


aE: 
a | 


> 
Il 


1 


converges for all t 4 2pm, p € Z. When t = 2pz, p € Z, then coskt = 1 for all 
k and the series > 1/k diverges. On the other hand, the series 


1 


;2 cos kt 


AE: 


> 
Il 


a 


converges for all t € R. 
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Exercises 7.2 


1. 


*(Abel’s Test) Prove that if }> az, converges, and {b,} is monotone and 
bounded, then >> ax bk converges. 
*Show by example that the hypothesis of Theorem 7.2.3 cannot be re- 
placed by 6b, > 0 and lim by = 0. 

k- co 
If )> ax converges, does S> az always converge? 


*Prove that 


= sin(n + 4)t — sin 4¢ 
S > cos kt = ( fay 2.) tA 2p, pe Z. 
Test each of the following series for sony oigence: 
ae (-1)* Ink ee (—1)* 
: Go a 0 b. ¥e, 
ps »P> ea a k ah 
k* = k* ee sink 
*d. > (-1)*t'_—__|"” 1)*t*}______*f, 
LOO g & hepa 2% ie 
£5 MH eR ps0 tio eG SH 
kai KP k=1 
i. SS (—1)**? sin(a/k) 
k=1 
Given that 
So 8 
k=1 


determine how large n € N must be chosen so that |x? /12 _ Sn < 1074, 
where sy is the nth partial sum of the series. 


If p and q are strictly positive real numbers, show that 


oe Ink)? 
saa 

pa eee 

converges. 


*Suppose that 5+ ax converges. Prove that 


lim = > kay = 0. 


noo 1 k=1 


As in Exercise 19 of Section 7.1, let cp = 1+ s pees + Z Ink. Set 
Qn (_1)kt1 
ied 14.2 - toe ed) 
2 3 2n k=1 k 
Show that lim b, = 1In2. (Hint: bn = can — cn + 1n2.) 
noo 


7.3 Absolute and Conditional Convergence 


In this section, we introduce the concept of absolute convergence of a se- 
ries. As we will see in this and subsequent sections of the text, the notion of 
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absolute convergence is very important in the study of series. We begin with 
the definition of absolute and conditional convergence. 


DEFINITION 7.3.1 A series S* a, of real numbers is said to be abso- 
lutely convergent (or converges absolutely) if )~ |ax| converges. The series 
is said to be conditionally convergent if it is convergent but not absolutely 
convergent. 


We illustrate these two definitions with the following examples. 


EXAMPLES 7.3.2 (a) Since the sequence {1/k} decreases to zero, by The- 
orem 7.2.3 the series )*(—1)**1/k converges. However, 


k= 


RB 


Thus the series )>(—1)**1/k is conditionally convergent. 


(b) Consider the series )>(—1)**1/k?. By Theorem 7.2.3 the alternating 
series converges. Furthermore, since )>1/k? < oo, the series is absolutely 
convergent. 


Our first result for absolutely convergent series is as follows: 


THEOREM 7.3.3 Every absolutely convergent series of real numbers con- 
verges. 


Proof. Suppose 5> a, converges absolutely; i.e. }> |ax| < oo. By the triangle 
inequality, for l<p<q, 


qd q 
Dd, ae] SD lax 
k=p k=p 


and the result now follows by the Cauchy criterion (Theorem 3.7.3). 


Remark. To test a series }> a, for absolute convergence we can apply any of 
the appropriate convergence tests of Section 7.1 to the series }~ |a;,|. There is 
however one important fact which needs to be emphasized. If the series > |a,| 
diverges by virtue of the ratio or root test, i.e., 


|an41| 


r= lim 
n—- oo |an| 


>1 or a= lim ¥/|a,| > 1, 


then not only does }*|a,| diverge, but )> a, also diverges. 
To see this, suppose a > 1. Then as in the proof of the root test, |a,| > 1 
for infinitely many &. Hence the sequence {az} does not converge to zero, and 
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thus by Corollary 3.7.5, > a, diverges. Similarly, if r > 1 and ifl<c<r, 
then as in the proof of Theorem 7.1.7(b), there exists a positive integer no 
and constant M such that 

lan| > Mc” 


for all n > no. Thus again, since c > 1, {a,} does not converge to zero, and 
the series )* a, diverges. We summarize this as follows: 


THEOREM 7.3.4 (Root and Ratio Test) Let S >a, be a series of real 


numbers, and let = 
a= lim V|ax|. 
k—-00 
Also, if a, £0 for allk EN, let 


R= lim 


k-0o 


Qk4+1 
ak 


Qk+1 
ak : 


and r= lim 
k-oo 


(a) Ifa<1orR<1, then the series \\ ax is absolutely convergent. 
(b) Ifa>1 orr >1, then the series S\ ax is divergent. 
(c) Ifa=1 orr<1< R, then the test is inconclusive. 


EXAMPLE 7.3.5 To illustrate the previous theorem we consider the series 
>> p(k) b*, where p is a polynomial and b € R with |b] < 1. In this example, 


k=1 
ax = p(k)b* and thus 


QAk+1 _ \2| en 1) 
ak 
Since jim, p(k + 1)/p(k) (Exercise =. lim |ax41/ax| = |b] < 1. Thus by 
k-00 


the ratio ‘test the series is ea convergent. 


Rearrangements of Series 


We next take up the topic of rearrangements of series. Loosely speaking, a 
series )> aj, is a rearrangement of the series )> a, if all the terms in the original 
series )* aj, appear exactly once in the series 5° aj,, but not necessarily in the 
same order. For example, the series 


1 1 1 1 1 1 1 


is a rearrangement of the series 
CO 
1 
Dae 
k=1 


The following provides a formal definition of this concept. 
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DEFINITION 7.3.6 A series )> aj, is arearrangement of the series )> ax 
if there exists a one-to-one function j from N onto N such that aj, = a;(%) for 
alk EN. 


A natural question to ask is the following: If the series }> a, converges and 
>> aj, is a rearrangement of )*a,, does the series )* aj, converge? If it con- 
verges, does it converge to the same sum. As the following example illustrates, 
the answer to both of these questions is no! 


EXAMPLE 7.3.7 Consider the series 


er ay Lt aed fat 
en ae ee Oe 


k=1 


which converges, but not absolutely. Consider also the following series which 
is a rearrangement of the above: 


14 vee 
Pee at + (3) 


Let 


As in the proof of Theorem 7.2.4, s < s2n41 for all n € N. In particular, 


see Ces 


Let si, denote the nth partial sum of the series (3). Then 


n 


1 1 1 
ee wes | 
n= (Ga " dk —1 x): 


k=1 
Since 
fiw; 2d 1 8k — 3 
4k—3 ' 4k—-1 2k  2k(4k—1)(4k—3) 
we have 1 i 1 1 
< 
OS a3 Tha OR oO 


for some constant M. Thus the sequence {s%,,} is strictly increasing, and by 
the comparison test converges. Let s’= lim s%,,. Since 
n—->oco 


/ 45h 
S3nt1 = $3n TG and 


/ = ¥ niin, ==, es 
Santa = Sin + 7a t ang 3? 
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the sequences {s3,,,,} and {s5,,;9} also converge to s’. Therefore lim s/, = s’. 


noo 
Thus the series (3) also converges. However, since 


Dy / / 
rim aa ie ee 


s' = lim s/, > 2. Thus the series (3) does not converge to the same sum as 
n—->co 


the original series. This, as we will see, is due to the fact that the given series 
does not converge absolutely. 


THEOREM 7.3.8 If the series \\ a, converges absolutely, then every rear- 
rangement of )- a, converges to the same sum. 


Proof. Let )> aj, be a rearrangement of > ax. Since > |ax| < 00, given € > 0, 
there exists a positive integer N such that 


Ye lawl < (4) 
k=n 


for allm > n> N. Suppose aj, = a;(,), where j is a one-to-one function of N 
onto N. Choose an integer p(p > N) such that 


{1,2,-5N} © {9(1), 52); +I D)F- 


Such a p exists since the function 7 is one-to-one and onto. Let 


n n 
Sn = y ak and Sp y ai, 
k=1 k=1 
If n> p, 
n n 
/ 
sn, 8 = ) ak — ) Q5(k)- 
k=1 k=1 


By the choice of p, the numbers aj,...,ay appear in both sums and conse- 
quently will cancel. Thus the only terms remaining will have index k or j(k) 
greater than or equal to N. Therefore by (4), 


ls, — s/,| < 2e 


for alln > p. Therefore lim s’/, = lim s,, and thus the rearrangement con- 
noo noo 


verges to the same sum as the original series. 


For conditionally convergent series we have the following very interesting 
result of Riemann. 


THEOREM 7.3.9 Let S >a, be a conditionally convergent series of real 
numbers. Suppose a € R. Then there exists a rearrangement )~ aj, of >> ax 
which converges to a. 
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Before proving the theorem, we illustrate the method of proof with the 
alternating series 


k= 


BB 


This series converges, but fails to converge absolutely. The positive terms of 
this series are P,, = 1/(2k — 1), k € N, and the absolute value of the negative 
1 
terms are Q; = 1/2k, k € N. Since > E70 we also have }> Py = > Qz = 
co. Suppose for purposes of illustration a = 1.5. Our first step is to add “just 
enough” positive terms to exceed a. More precisely, we let m , be the smallest 
integer such that P}+---+Pm, >a. Fora = 1.5, m, = 3; ie., 1+$+¢ > 1.5 
whereas 1 + 3 < 1.5. Our next step is to go in the other direction; namely, we 
let ny be the smallest integer such that 


Py tes) + Pm, - Q1- ++ -— Qn, <a. 


Again, for a = 1.5,n; = 1, and 1+ 3+4%-—4 < 1.5. We are able to do this 
since the series )* P, and )> Q, both diverge to oo. We continue this process 
inductively. Choosing the smallest integers m, and nz, at each stage of the 
construction will be the key in proving that the resulting series converges to 
Q. 


Proof. Without loss of generality we assume that a, 4 0 for all k. Let px, and 
dz be defined by 


(lax| — ax). 


ND] re 


1 
Pk = 3 (lanl + ax) and dk = 


Then pr — qx = ap and pr + qe = |ax|. Furthermore, if a, > 0, then q, = 0 
and pz = ag; if a, < 0, then py = 0 and qx = lag. 
We first prove that the series }> p, and 5° qx both diverge. Since 


Co Co 
Die + ae) = Do laal, 
k=1 k=1 
they cannot both converge. Also, since 


n n n 
~ ~ ~ 

» ak = » Pk— , qk) 

k=1 k=1 


k=1 


the convergence of one implies the convergence of the other. Thus they both 
must diverge. 

Let P,, P2, P3,... denote the positive terms of 5> a, in the original order, 
and let Qi, Q2, Q3,... be the absolute values of the negative terms, also in the 
original order. The series )> P, and )> Q, differ from 57 p, and >> q, only by 
zero terms and thus are also divergent. 
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We will inductively construct sequences {m,} and {n,} such that the series 


Py+---4 Ree Qi--:: Qn, f Pry +1 f + Pm — Qn 41-1 - Qn te°: (5) 


has the desired property. Clearly (5) is a rearrangement of the original series. 
Let m1 be the smallest integer such that 


Ki Pp wede Po Sa, 


Such an m, exists since )> Py = co. Similarly, let n; be the smallest integer 
such that 
Y, = X1—- Qi -—-:--— Qn, <a. 


Suppose {my ,...,™m,} and {n1,...,n~} have been chosen. Let mg41 and ng41 
be the smallest integers greater than m, and nx respectively such that 

Xeai = Ye + Pmyti tess + Pings > % and 

Yr a Xk41 _ Qnptl ee eh TS Qrigi <a, 
Such integers always exist due to the divergence of the series }> P;, and S> Qx. 
Since m,z41 was chosen to be the smallest integer such that the above holds, 


Xrpi- P, 


Mr+1 


<a. 


Therefore 
0< Xk4+1 -a< Pri: 
Similarly, 
0< a—Yrq1 < Qnegr: 
Since > a, converges, we have lim Py = lim Q; = 0. Therefore, 
k—-oo k—-o0o 
lim X; = lim Y¥, =a. 
k—-o0o k- 00 
Let S;, be the nth partial sum of the series (5). If the last term of S,, is a 
P,,, then there exists a k such that 
Ye < Sn < Xp41- 
If the last term of S;, is —Qn, then there exists a k such that 


Yeqi < Sn < Xe41- 


In either case we obtain lim $,, = a, which proves the result. 
noo 


Remark. By a variation of the above proof one can show that if the series 
>> ay is conditionally convergent, then given a, 6 with 


—o<ax<BP<so, 
there exists a rearrangement 5° aj, of }> a, such that 


lim S, =a, and lim 5 = 8; 
noo noo 


where S,, is the nth partial sum of > aj, (Exercise 13). 
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Exercises 7.3 


1. 


7. 


8. 


10. 


11. 


12. 


Prove the following: 


a. If jim k? a, = A for some p > 1, then >> ax, converges absolutely. 
00 


b. If jim kar = A #0, then >> a,x diverges. 
oo 
ce. If jim kax = 0, then the test is inconclusive. 
— 00 
*Suppose }> az < co and 3> bz < oo. Prove that the series 7 axb, con- 
verges absolutely. 


a. Prove that if S*a, converges and 5+ by, converges absolutely, then 
> arb converges. 


b. Show by example that the conclusion may be false if one of the two 
series does not converge absolutely. 


*Suppose that the sequence {b, } is monotone decreasing with lim by = 0. 
If {a,} is a sequence in R satisfying |an| < bn — bn+i for all n € N, prove 
that S> a, converges absolutely. 


a. If }> ax converges absolutely, prove that 5* eax converges for every 
choice of e€, € {—1, 1}. 


b. If S* exax converges for every choice of ex € {—1,1}, prove that }> ax 
converges absolutely. 


Test each of the following series for absolute and conditional convergence. 


a. Wo (-)*t —  (—1)* a  (=1)F tt 
ee BD Tene > ,p>o 


k=1 k=3 k=1 
“. (—1)* In(ink) =. (-1)* SS. (HFK 
d. ~—___——_ *e. f. ——____ 
» a e dkny’? > ° et 
 (=1)*ttk* = kt+i ge [1 on el. 
* * 
ee CE h. Di(-h sin ( EMD ec 
fy, ee 2) — k a k? + (-1) 
Ok 
Test the series oa = p €R, for absolute and conditional convergence. 
k=1 
Prove that lim Ine + DI = 1 for any polynomial p. 
ko0  |p(k)| 


*Show that the series 1 + ; 1 + : : +--+ diverges. 
1 1 of 1 1 
3 


Determine whether the series 1 


+ 
il 
5 t+++ converges 
or diverges. 


sink 
k 


*Prove that the series .s 

k=1 
If ax > 0 for all k € N, and S> a, = x, prove that S* aj, = oo for any 
rearrangement )~ a}, of )> ax. 


is conditionally convergent. 
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13. Suppose that the series S~ a, is conditionally convergent. Given a, 6 with 
—oo < a < 8 < co, show that there exists a rearrangement > a, of > ax 
such that lim S, =aand lim S,, = (~, where S,, is the nth partial sum 

noo 


of > a! n—-+>oo 
ke 


14. Suppose every rearrangement of the series }> ax converges, prove that 
> ax converges absolutely. 


7.4 Square Summable Sequences? 
In this section, we introduce the set £? of square summable sequences of real 
numbers and derive several useful inequalities. This set occurs naturally in 


the study of Fourier series. 


DEFINITION 7.4.1 A sequence {ax}72, of real numbers is said to be in 
é?, or to be square summable, if 


[oe} 
S- ae < OO. 
k=1 

For {ax} € @ set 


IIx lle = 


The set ¢? is called the space of square summable sequences, and the 
quantity ||{az}||2 is called the norm of the sequence {ax}. 


Remark. Since a sequence {a;,} in R is by definition a function a from N into 
R with a, = a(k), it is sometimes convenient to think of ¢? as the set of all 
functions a: N > R for which 


llall2 = 


?The topic of square summable sequences, although important in the study of Fourier 
series, is not specifically required in Chapter 9 and thus can be omitted on first reading. The 
concept of a normed linear space occurs on several occassions in the discussion of subsequent 
topics in the text. At that point the reader can study this topic more carefully. 
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EXAMPLES 7.4.2 (a) For the sequence {1/k}?<,, 


WC /4}2 = D2 oy. 
k=1 


Since this is a p-series with p = 2, the series }>1 / k? converges and thus 
{1/k} € @. On the other hand, since 


IKa/VE}IB = Joo = 00, 
k=1 


we have {1/ Vk} ¢ 07. 
(b) For fixed g, 0 < q < c, consider the sequence {1/k7}. Then 


1 
2 
Ia/R 8 = Dae 
=) 


By Example 7.1.9(a) this series converges for all g > 1/2 and diverges for all 
q < 1/2. Thus {1/k%} € @ if and only if q > 1/2. 


Cauchy-Schwarz Inequality 


Our main goal in this section is to prove the Cauchy-Schwarz inequality for 
sequences in ¢?. First however we prove the finite version of this inequality. 


THEOREM 7.4.3 (Cauchy-Schwarz Inequality) Ifn € N and aj,..., an 


and bj,...,b, are real numbers, then 


n 


S- laxbe| < 


k=1 


Yat SR. 


k=1 
Proof. Let \ € R and consider 


< S$ (lax| — Albel) = Sel £2) loch +98 5 ab 
k=1 


The above can be written as 


0<A-—2\C+)7B 


where A = a, aC = S |axbx|, and B= Py b2. If B = 0, then by = 0 for 


=1 
all k =1,...,n and the Caickye Schwarz ficqualiy certainly holds. If B ¥ 0, 
we take ie C 7 B which gives 
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or C? < AB; that is, 


(Ee) « (Ex) (Ex) 


Taking the square root of both sides gives the desired result. 


As a consequence of the previous result we have the following corollary. 


COROLLARY 7.4.4 (Cauchy-Schwarz Inequality) Jf {a,}, {b,} € @, 


then S> axby is absolutely convergent and 
k=1 


do lands S [ardll2 | {be }ll2- 
k=1 


Proof. For each n € N, by the previous theorem 


n 


S- laxbe| < 


k=1 


S- az.) ¥>b2 < [[fax}llall {be} lle- 


k=1 k=1 


Letting n — oo gives the desired result. 


For a,b € @ the inner product of a and b, denoted (a,b), is defined as 


(a, b) = S- Apdg.- 
bol 


As a consequence of the Cauchy-Schwarz inequality we have 


|(a, b, )| << |lall2l|blle- 


Minkowski’s Inequality 


Our next result shows that the norm || ||2 satisfies the “triangle inequality” on 
#} 


THEOREM 7.4.5 (Minkowski’s Inequality) /f {a,} and {by} are in 0, 
then {ax + bx} € @ and 


Ian + be fll < [ax tlle + [bx FIle. 


Proof. By hypothesis, each of the series S> az and 5>b? converge. Also, by 
Corollary 7.4.4 the series }> a,b; converges absolutely. Since 


(ax + by)? = az + 2axby + be < ae + 2laxb,| + be 
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we have 
IIfax + de }I3 = So (an + dx)? < land +2 5— lands + {Ox HS, 
k=1 k=1 


which by the Cauchy Schwarz inequality 


S [aw }llo + 2llfax}llal{edlle + I {bed 
= ([I{aehll2 + {be }ll2)”. 


Taking the square root of both sides gives the desired result. 


Although not specifically stated, Minkowski’s inequality is also true for 
finite sums. In particular ifn € N and aj,..., an, b1,...,b,, are real numbers, 
then 


n 


So (an + dx)? < ,| So az +,| 5. bp. (6) 
k=1 k=1 


k=1 


In the following theorem we summarize some of the properties of the norm 
|| ||z2 on @?. These are very similar to the properties of the absolute value 
function on R. As for the absolute value, the inequality 


I[{an + bef lle < [ex dle + [bat lle 


is also referred to as the triangle inequality for @?. 


THEOREM 7.4.6 The norm || ||2 on @? satisfies the following properties: 
(a) ||{ax}|l2 > 0 for all {ay} € @. 
(b) ||{ax}|lo = 0 tf and only if a, =0 for allk EN. 
(c) If {ax} € 1? andc ER, then {cax} € @ and 
I[{cax}ll2 = lel [tax flle- 
(d) If {ax}, {bc} € @, then {ax + be} € 2 and 
Ian + be fll < [ax tlle + [be dll. 


Proof. The results (a) and (b) are obvious from the definition, and (d) is just 
a restatement of Minkowski’s inequality. The verification of (c) is left as an 
exercise (Exercise 5). 


Normed Linear Spaces 


The space ¢? as well as R” are both examples of vector spaces over R. For 
completeness we include the definition of a vector space. 
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DEFINITION 7.4.7 A set X with two operations “+”, vector addition, and 
“”~ scalar multiplication, satisfying 
x+yeEx forall x,yExX, and 
cxEe xX forall xEX,cER 


is a vector space over R if the following are satisfied: 

(a)x+y=y+x. (commutative law) 

(b) x+(y+z)=(x+y)+z. (associative law) 

(c) There is a unique element in X called the zero element, denoted 0, 
such that 


x+0=x forall xE xX. 


(d) For each x € X, there exists a unique element —x € X such that 
x +(—x) =0. 

(e) (ab) -x =a- (b-x) for alla,bE R,xEX. 

(f) a-(x+y)=a-x+bD-y. 

(g) (a+b)-x=a-x+0b-x. 

(h) 1-x =x. 


It is clear that R” with + and - defined by 
a+b =(a,+h1,...,Gn + bn), 
c:a= (cd),...,CAn) 


is a vector space over R. Similarly if addition and scalar multiplication of 
sequences {az}, {by} in ? are defined by 


{ax} + {be} = {ax + be}, 
c- {ak} = {car}, ceR, 
then it is easily shown that (? is a vector space over R. The fact that {a, +z} 


and {cax} are in @? is part of the statement of Theorems 7.4.5 and 7.4.6. The 
zero element 0 in £? is the sequence {a,} where a, = 0 for all k EN. 


In addition to being vector spaces, the spaces R” and £? are also examples 
of normed linear spaces. The concepts of a “normed linear space” as well as 
that of a “norm” are defined as follows: 


DEFINITION 7.4.8 Let X be a vector space of R. A function || ||: X >R 
satisfying 
(a) ||x|| > 0 for allx eX, 
(b) ||x|| = 0 ¢f and only if x = 0, 
(c) ||cx|| = |e ||x|| for allc ER, x € X, and 
(d) ||x+yll < |Ixll + llyll for allx, ye X, 
is called a norm on X. The pair (X,|| ||) 1s called a normed linear space. 
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Inequality (d) is called the triangle inequality for the norm || ||. By 
Theorem 7.4.6, (€7,|| ||2) is a normed linear space. Additional examples of 
normed linear spaces will occur elsewhere in the book, both in the text and 
the exercises. 


If (X,|| ||) is a normed linear space, the distance d(x,y) between two 
points x, y € X is defined as d(x,y) = ||x — y||. From the definition of the 
norm || ||, it immediately follows that 

(a) d(x, y) > 0 for allx, ye X, 

(b) d(x, y) = 0 if and only ifx =y, 

(c) d(x,y) = d(y,x), and 

(d) d(x,y) < d(x,z) + d(z,y) for allx, y,z€ X. 
Thus d is a metric on the vector space X. Since the notions of “limit point of 
a set” (Definition 2.2.12) and “convergence of a sequence” (Definition 3.1.1) 
are defined in terms of e-neighborhoods, both of these concepts have analogous 
definitions in a normed linear space (X,|| ||). Thus for example, a sequence 
{x,} in X converges to x € X, if given € > 0, there exists n, € N such that 
Xn — x|| < € for alln EN, n > no. This type of convergence, referred to as 
norm convergence, will be encountered again later in the text. 

As a general rule, many of the results involving sequences of real numbers 
are still valid in the setting of normed linear space. This is especially true for 
those theorems whose proofs relied only on properties of the absolute value. 
Great care however must be exercised with theorems that rely on the supre- 
mum property of R. For example, the Bolzano-Weierstrass theorem fails for 
(7, || |l2) (Exercise 6). On the other hand however, the Bolzano-Weierstrass 
theorem still holds in (R”, || ||2) (Miscellaneous Exercise 5). 


Exercises 7.4 


1. Determine which of the following sequences are in 7. 


mtd. Maik, teal, CY, 
Ink J,» VkInk J ,=2 VES pao Be aeeg 


2. Determine all values of p € R such that the given sequence is in £7. 


Z KP RS lige 1 7 
*acioe b. {a} tc. {eo} tae 
{p as PF S par RPI fp Vk(Ink)? a 


3. *If {a} € 0’, prove that >> a,/k converges absolutely. 
h=1 


4. Give an example of a sequence {ax} € 0? for which S> |ag| = 00. 
k=l 


If {ax} € # andc ER, prove that {cay} € @ and ||{cax}||2 = |el||{ax}|l2- 
For each n € N, let en be the sequence in @? defined by 


0, kn, 
oun) = {1 pe 
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Show that ||len — em|l2 = V2 ifn 4 m. (Remark. The sequence {en} 
is a bounded sequence in ¢? with no convergent subsequence. Thus the 
Bolzano-Weierstrass theorem (3.4.6) fails in €?. ) 


7. Show that equality holds in the Cauchy-Schwarz inequality if and only if 
for all k € N, 6b, = cay, for some c € R. 


8. Fora, b € R”, let (a,b) denote the inner product of a and b. Prove each 
of the following: 
a. (a,a) > 0. 
b. (a,a) = 0 if and only if a = (0,..., 0). 
c. (a,b +c) = (a,b) + (a,c). 


( 
e. (a,b) = 5 [llall2 + ||bl|2 — |la — bI/2]. 
9. *For a,b € R”, use the law of cosines to prove that (a,b) = 


||al|2||b||2 cos @, where @ is the angle between the vectors a and b. 


10. Let (X,|| ||) be a normed linear space. Prove that | ||x|| — ||y|| | < ||x—y]| 
for all x, y € X. 


co 


11. Let £' denote the set of all sequences {ax} satisfying ||{ax}|]1 = 3° Jax] < 


oo. 
a. Prove that (¢, || ||1) is a normed linear space. 
*b. Prove that £' ¢ @. 
12. Determine all values of p € R for which each of the sequences in Exercise 
2 is in £* 
13. Let X be a non-empty set, and let B(X) denote the set of all bounded 
real-valued functions on X. For f € B(x), set 


Il flloo = sup{|f()| : x € X}. 


Prove that (B(X), || ||...) is a normed linear space. 


Notes 


The geometric series is perhaps one of the most important series in analysis. In the 
seventeenth and eighteenth century, the convergence of many series was established 
by comparison with the geometric series. It forms the basis for the proof of the 
root and ratio test, and thus also for the study of convergence of power series. The 
geometric series dates back to Euclid in the 3rd century B.C. The formula for a finite 
sum of a geometric progression appeared in Euclid’s Elements, and Archimedes, in 
his treatise Quadrature of the Parabola, indirectly used the geometric series to find 
the area under a parabolic arc.* Even though Greek mathematicians knew how to 


3See p. 105 of the text by Katz. 
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sum a finite geometric progression, they used reducto ad absurdum arguments to 
avoid dealing with infinite quantities. 

Infinite series first appeared in the middle ages. In the fourteenth century, Nicole 
Oresme (1323?-1382) of Italy provided a geometric proof to the effect that the 
infinite series 


92 
had sum equal to 2, a result now quite easy to prove using power series. He was 
also the first to prove that the harmonic series diverged, whereas the Italian math- 
ematician Pietro Mengoli (1624-1686) was the first to show that the sum of the 
alternating harmonic series 1 — $ + 3 = + +--- is n2. The results of Oresme and 
Mengoli, as well as others of this era, were stated verbally; the infinite sum notation 
did not appear until the seventeenth century. 

With the development of the calculus in the mid seventeenth century, the em- 
phasis shifted to the study of power series expansions of functions, and computations 
involving power series. The expansion of functions in power series was for Newton, 
and his successors, an indispensable tool. In his treatise Of the Method of Fluxions 
and Infinite series*, Newton includes a discussion of infinite series techniques for the 
solution of both algebraic and differential equations. Both the geometric series and 
the binomial series were employed in many of his computations. 

During the seventeenth and eighteenth century, mathematicians operated with 
power series in the same way as with polynomials; often ignoring questions of con- 
vergence. An excellent illustration of these eighteenth century techniques is Euler’s 
derivation of the sum of the series 


The convergence of this series had already been established earlier by Johann 
Bernoulli. Using results from the theory of equations and applying them to the 
power series expansion of sinz, Euler was able to show that the sum of the given 
series was 17/6 °. 

As power series were used more frequently to approximate mathematical quan- 
tities, the emphasis turned to deriving precise error estimates in approximating a 
function by a finite sum of the terms of its power series. In 1768, d’Alembert made 
a careful examination of the binomial series (1+ 7)’, p € Q, discovered earlier by 
Newton®. D’Alembert computed the value of n for which the absolute value of the 
ratio of successive terms is less than 1, thereby ensuring that the successive terms 
decrease. More importantly, d’Alembert computed the bounds on the error made 
in approximating (1+ 1)? by a finite number of terms of this series. His argument 
relied on a term by term comparison with a geometric series, similar to the proof 
used in establishing the ratio test. D’Alembert’s result can easily be converted into 
a proof of the convergence of the series. 

Computations analogous to those of d’Alembert were also undertaken by La- 
grange in this book Théorie des Fonctions Analytiques published in 1797. The re- 
mainder term for Taylors formula (to be discussed in the next chapter) first appeared 


4The Mathematical Works of Issac Newton, edited by D. T. Whiteside, Johnson Reprint 
Corporation, New York, 1964. 

5For details the reader is referred to the article by J. Grabiner. 

6 Réflexions sur les suites ét sur les racines imaginaires, Opuscules Mathématiques, vol. 
5 (1768), pp. 171-215. 
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in this text. Cauchy was undoubtedly influenced by the works of d’Alembert and 
Lagrange in his definition of convergence of a series. However, unlike the results of 
d’Alembert, which applied only to the binomial series, and those of Lagrange for 
Taylor series, Cauchy’s definition of convergence was entirely general; applicable to 
any series of real numbers. 

Using his definition of convergence, Cauchy proved that the statement now 
known as the Cauchy criterion was necessary for the convergence of a series of 
real numbers. This was was also known earlier to Bolzano. However, without the 
completeness property of the real number system, neither Bolzano nor Cauchy were 
able to prove that the Cauchy criterion was also sufficient for convergence of the 
series. 


Miscellaneous Exercises 
co co n 
1. Given two series 5> ap and >> be, set Cr = SY arbn—r, n=0,1,2,.... 
k=0 k=0 k=0 


The series }> cn is called the Cauchy product of }> az and S> bp. 
n=0 


a. If >a, and >> b; converge absolutely, prove that }* cn converges ab- 
solutely and that 


Zo= (Ex) (2%): 


b. Let ax = be = (-1)*/Vk+ 1, k = 0,1,2... Prove that the Cauchy 
product of 5> ax and S~ by diverges. 


c. Prove that the result of (a) is still true if only one of the two series 
converge absolutely; the other series must still converge. 
2. Let X be a non-empty set. If f is a real-valued function on X, define 
|f\l1 = sup{ >> |f(x)|: F is a finite subset of X}. 
2eF 


In the above, the supremum is taken over all finite subsets F’ of X. Denote 
by £'(X) the set of all real-valued functions f on X for which || f||1 < co. 


a. Suppose X is infinite. If f € ¢'(X), prove that {a © X : f(x) £ 0} is 
at most countable. 


b. If {a € X : f(x) A O} = {an : n € A}, where A CN, prove that 
IIfll1 = 2 |F(@n)l- 


c. Prove that (¢'(X), || ||1) is a normed linear space. 
3. For f € R[a, b], set 


fla = [fr@? ae| ae 


b 
a. Prove that for f, g € R[a,b], f|f(x)g()| dx < ||flleliglle- 


a 
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b. For f, g € RIa, b], prove that || f+ gll2 < ||fll2 + llglle. 


c. Prove that || ||2 defines a norm on C[a,b], the space of continuous 
real-valued functions on [a, }]. 


d. Is || ||2 a norm on R{a, b]? 


4. As in the previous exercise, let C[a, b] denote the vector space of continu- 
ous real-valued functions on [a, b]. For f € C[a, 8], set || f ||. = max{|f(x)| : 
x € [a, b]}. 


a. Prove that || ||. is a norm on C[a, }]. 


b. Prove that a sequence {f,,} in C[a,b] converges to f € C[a,b] if and 
only if given € > 0, there exists no € N such that | f(x) — fn(x)| < ¢€ for 
all x € [a,b] and alln EN, n> no. 


Definition (a) Let (X,|| ||) be a normed linear space, and let E C X. 
A function f : £ > R is continuous at p € F if given e > 0, there exists 
a 6 > 0 such that 


\f(x) — f(p)| <e for all x € E with ||x — p]| < 6. 


(b) Let X be a vector space over R. A function f : X — R is linear if 


f (ax + by) = af (x) + bf(y) 
for allx, ye X anda, beER. 


5. Let (X,|| ||) be a normed linear space and let f : X — R be a linear 
function. Prove that the following are equivalent. 


a. f is continuous at some p € X. 
b. f is continuous at 0. 


c. There exists a positive constant M such that |f(x)| < M||x|| for all 
xEX. 


d. There exists a positive constant M such that | f(x)—f(y)| < M||x—y]| 
for allx,y € X. 


e. f is uniformly continuous on X. 
6. For fixed b € @?, define [ : @? > R by I'(a) = (a,b) = Yo a(k)b(k). 
Prove that T is a continuous linear function on @?. 


7. As in Exercise 3, let C[a,b] denote the vector space of continuous real 
valued functions on [a,b] with norm || ||2. For fixed g € R[a,b], prove 
that [ defined by 


P(f) = f fle)g(«) de 


is a continuous linear function on C[a, bJ. 
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Sequences and Series of Functions 


In this chapter, we will study convergence properties of sequences and series 
of real-valued functions defined on a set E. In most instances F will be a 
subset of R. Since we are dealing with sequences and series of functions, there 
naturally arise questions involving preservation of continuity, differentiability, 
and integrability. Specifically, is the limit function of a convergent sequence 
of continuous, differentiable, or integrable functions again continuous, differ- 
entiable, or integrable? We will discuss these questions in detail in Section 1 
and show by examples that the answer to all of these questions is in general 
no! Convergence by itself is not sufficient for preservation of either continuity, 
differentiability, or integrability. Additional hypotheses will be required. 

In the 1850’s Weierstrass made a careful distinction between convergence 
of a sequence or series of numbers and that of a sequence or series of func- 
tions. It is to him that we are indebted for the concept of uniform convergence 
which is the additional hypothesis required for the preservation of continuity 
and integrability. It was also Weierstrass who constructed a continuous but 
nowhere differentiable function, and who proved that every continuous real- 
valued function on a closed and bounded interval can be uniformly approx- 
imated by a polynomial. As prominently as Cauchy is associated with the 
study of sequences and series of numbers, Weierstrass is likewise associated 
with the study of sequences and series of functions. For his many contributions 
to the subject area, Weierstrass is often referred to as the father of modern 
analysis. 

The study of sequences and series of functions has its origins in the study 
of power series representation of functions. The power series of In(1 + 2) was 
known to Nicolaus Mercator (1620-1687) by 1668, and the power series for 
many of the transcendental functions such as arctan 2, arcsinxz, among oth- 
ers, were discovered around 1670 by James Gregory (1625-1683). All of these 
series were obtained without any reference to calculus. Newton’s first discov- 
eries, dating back to the early months of 1665, resulted from his ability to 
express functions in terms of power series. His treatise on calculus, published 
posthumously in 1737, was appropriately entitled A treatise of the method of 
fluzions and infinite series. Among his many accomplishments, Newton de- 
rived the power series expansion of (1 + 2)'/" using algebraic techniques. 
This series and the geometric series were crucial in many of his computa- 
tions. Newton also displayed the power of his calculus by deriving the power 
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series expansion of In(1 +) using term-by-term integration of the expansion 
of 1/(1+ 2). The mathematicians Colin Maclaurin (1698-1746) and Brooks 
Taylor (1685-1731) are prominent for being the first mathematicians to use 
the methods of the new calculus in determining the coefficients in the power 
series expansion of a function. 


8.1 Pointwise Convergence and Interchange of Limits 


In this section, we consider a number of questions involving sequences and 
series of functions and interchange of limits. Some of these questions were 
actually believed to be true by many mathematicians prior to the nineteenth 
century. Even Cauchy in his text Cours d’Analyse “proved” a theorem to the 
effect that the limit of a convergent sequence of continuous functions was again 
continuous. As we will shortly see, this result is false! 


To begin our study of sequences and series of functions we first define 
what we mean by pointwise convergence of a sequence of functions. If E is a 
nonempty set and if for each n € N, fy, is a real-valued function on E, then 
we say that {fn} is a sequence of real-valued functions on FE. For each 
x € E, such a sequence gives rise to the sequence {f,(x)} of real numbers, 
which may or may not converge. If the sequence {f,(x)} converges for all 
x € E, then the sequence {f,,} is said to converge pointwise on FE, and by the 
uniqueness of the limit 


f(x) = Jim, fala) 


defines a function f from E into R. We summarize this in the following defi- 
nition. 


DEFINITION 8.1.1 Let (X,d) be a metric space and let E C X. Let 
{fn}o1 be a sequence of real-valued functions defined on E. The sequence 
{fn} converges pointwise on E if {fn(x)}°, converges for every x € E. 
If this is the case, then f defined by 


f(x) = lim fp (x), Lek, 


noo 
defines a function on EF. The function f is called the limit of the sequence 


{fr}. 


In terms of € and no, the sequence {f,} converges pointwise to f if for 
each « € E, given € > 0, there exists a positive integer no = no(x,€) such that 


|fn(x) — f(x)| <e€ 


for all n > no. The expression ng = no(x, €) indicates that the positive integer 
No may depend both on € and x € E. 
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If as above, { f, }92 1 is a sequence of real-valued functions on a nonempty 


set E, then with the sequence {f,,} we can associate the sequence {S,,} of 
nth partial sums, where for each n € N, S,, is the real-valued function on E 
defined by 


n 


Sn(e) = fila) +---+ fala) = >> f(a). 


k=1 
The sequence {S,,} is called a series of functions on E denoted by s fe or 
simply )> f,. The series )* f;, converges pointwise on F if for ee E€E 
the sequence {S;,(a)} of partial sums converges; that is, the series ss fr (2) 
converges for each x € E. If the sequence {S,,} converges sointwies - the 
function S on FE, then S is called the sum of the series )> f,; and we write 


co 
S = >> fx, or if we wish to emphasize the variable x, 
k=1 


S(z) = So fe(z), cek. 
k=l 


Suppose f, : [a,b] > R for all n € N, and f,(a) > f(x) for each x € [a, b]. 
Among the questions we want to consider are the following: 


(a) If each f,, is continuous at p € [a,b], is the function f continuous at 
p? Recall that the function f is continuous at p if and only if 


lim f(t) = f(p). 


Since f(x) = lim fn(x), what we are really asking is whether 


lim (lim fn(t)) = lim (tim In(t)) ? 


tp \n-oo noo \t->p 


(b) If for each n € N the function f,, is differentiable at p € [a,b], is f 
differentiable at p? If so, does 


f'(p) = lim _ f,(p)? 


(c) If for each n € N the function f,, is Riemann integrable on [a,b], is f 
Riemann integrable? If so, does 


b b 
/ f= lim | fa? 
a noo a 


We now provide a number of examples to show that the answer to all of 
the above questions is in general no. 
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EXAMPLES 8.1.2 (a) Let E = [0,1], and for each « € E,n € N, let 
fn(x) = x”. Clearly each f, is continuous on E. Since f,(1) = 1 for all n, 
Jim, fx(l) = 1. If 0 < a < 1, then by Theorem 3.2.6(e), Jim fn(z) = 0. 
Therefore 

0, O0<a<l, 

ga. 


lim f(z) = f(x) -| 


The function f however is not continuous on [0,1]. (In Exercise 1 you will be 
asked to sketch the graphs of fi, fo, fa.) 


(b) Consider the sequence { f;,}?2.9 defined by 


a 


fe(x) = (422) rER. 


For each k = 0,1,2,.., fj, is continuous on R. Consider the series }> fj, which 
k=0 
for each x € R is given by 


Sfied= oe (TEs) - 


We now show that this series converges for all x € R and also find its sum 
f. If « = 0, then f;,(0) = 0 for all k, and thus f(0) = 0. If x # 0, then 
1/(1+ 2?) < 1 and hence by Example 3.7.2(a) 


i u an 2 al = Wes cee. 
' ie - |; | =248 ae 


1+a2 
Therefore 
0, x =0, 
f(x) = , 
1l+a*, «x40, 


which again is not continuous on R. 


(c) Let {x,} be an enumeration of the rational numbers in [0, 1]. For each 
n EN, define f, as follows: 


0, ifvr=ap,1<k<n, 
fn(x) = . 
of otherwise. 


Since each f, is continuous except at %1,...,%n, fn is Riemann integrable on 
[0,1] with [> f,(w)dx = 1. On the other hand, 


lim fn(#) = f(x) = 


n—->co 


' if x is rational, 
1 


; if x is irrational, 


which by Example 6.1.6(a) is not Riemann integrable on [0, 1]. 
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(d) For z € [0,1],n €N, let f,(x) = nax(1 — x7)”. Since each f, is 
continuous, f, is Riemann integrable on [0,1]. If 0 < x < 1, then0 < 1-2? < 
1, and thus by Theorem 3.2.6 


lim na(l—a27)"=0, if O<2<1. 
Finally, since f,(0) = fr(1) = 0, we have 
f(x) = lim f(x) =0 for all x € [0,1]. 
noo 


Thus f is also Riemann integrable on [0,1]. On the other hand, 


1 1 
1 
| fn(x) dx =n | g(1—2?)" dr = eee 
Therefore, 
1 1 1 
lim fr(a)da =~ A#0= ] f(x)de 
noo Joy 2 0 
(e) As our final example, consider f,(”) = saa ee x ER. Since |sinna| < 
n 


1 for allza € RandneN, 
f(x) = lim fn(x) =0 forallz eR. 
Therefore f’(x) = 0 for all x. On the other hand, 


fi. (x) = cosnz. 


In particular f/ (0) = 1 so that lim f/(0) =1¥ f’(0). This example shows 
n->co 
that in general 


“(lim fa(x)) # lim fi, (2). 


dx 


Additional examples are also given in the exercises. 


Exercises 8.1 


1. Let fn be as in Example 8.1.2. Sketch the graphs of fi, fe, and fa. 


2. Find the pointwise limits of each of the following sequences of functions 
on the given set. 


*a, oe , « €[0,00) b. { ae \. x € [0, 00) 
1+ nz l+nz 
*c. {(cosx)*"}, xER. d. {nae} , «eR. 
3. Determine the values of x for which each of the following series converge. 
5 na” b = He 1 


ob 


n=1 
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4. For n EN, define f, : N — R by fn(m) = n/(m+n). Prove that 
lim ( lim fn (m)) ~ lim ( lim fn (m)). 
moo n—-oo n—oo moo 
5. Consider the sequence {fn} with n > 2, defined on [0,1] by 


na, 0<a<1/n, 
fn(z) =< Inne, 1f/n<a<2/n, 
0, 2/n<a<l. 


a. Sketch the graph of f, for n = 2, 3, and 4. 
b. Prove that lim f(x) =0 for each x € [0, 1]. 
nm—oo 


*c. Show that Jes fn(x) dx = 1 for all n = 2,3,.... 
6. Let gn(x) =e "*/n, x € [0,00), NEN. Find lim gn(x) and lim gj,(z). 


7. Let fn(x) = (x/n)e*/™, x € [0, 00). 
*a. Show that lim fn(x) = 0 for all x € [0, 00). 
n—-oo 
*b. Given € > 0, does there exist an integer no € N such that |fn(x)| < € 


for all x € [0,00) and all n > no. (Hint: determine the maximum of fy 
on [0, 00)) 


c. Answer the same question as in (b) for x € [0,a], a> 0. 
8. *If dnjm > 0, n,m EN, prove that 
co co co co 
do dp am = DD anim; 
n=l1m=1 m=l1n=1 


with the convention that if one of the sums is finite, the other is also and 
equality holds, and if one is infinite, so is the other. 


8.2 Uniform Convergence 


All of the examples of the previous section show that pointwise convergence by 
itself is not sufficient to allow the interchange of limit operations; additional 
hypotheses are required. It was Weierstrass who realized in the 1850’s what 
additional assumptions were needed to insure that the limit function of a 
convergent sequence of continuous functions was again continuous. 


Recall from Definition 8.1.1, a sequence {f,} of real-valued functions de- 
fined on a set E converges pointwise to a function f on EF if for each x € E, 
given € > 0, there exists a positive integer no = no(x,€) such that 


If(x) — frla)| <e 


for all n > no. The key here is that the choice of the integer ny may depend 
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not only on ¢, but also on x € E. If this dependence on x can be removed, 
then we have the following: 


DEFINITION 8.2.1 A sequence of real-valued functions {f,} defined on a 
set E converges uniformly to f on E, if for every « > 0, there exists a 
positive integer no such that 


|fn(x) — f(@)| <e 


for alla € E and alln > no. Similarly, a series S> fy of real-valued functions 


k=1 
converges uniformly on a set E if and only if the sequence {S,,} of partial 
sums converges uniformly on E. 


The inequality in the definition can also be expressed as 


f(a) —€< fnl@) < fle) + 


for alla € EF and n> no. If FE is a subset of R, then the geometric interpre- 
tation of the above inequality is that for n > n, the graph of y = f,(x) lies 
between the graphs of y = f(a) —e and y = f(x) +. 


EXAMPLES 8.2.2 (a) For x € [0,1], n EN, let f,(v) = 2”. By Example 
8.1.2(a), the sequence {f,} converges pointwise to the function 


ro) {" 0<2<1, 


gad, 


We now show that the convergence is not uniform. If the convergence were 
uniform, then given € > 0, there would exist a positive integer n, such that 
|fn(x) — f(x)| < € for all n > no. In particular, 


we <e forall 2 € (0,1). 


This however is a contradiction if ¢ < 1. Even though the convergence is not 
uniform on [0,1], the sequence does converge uniformly to 0 on [0, a] for every 
a,0 <a < 1. This follows immediately from the fact that for x € [0,al, 
|fn(a)] = |a”| Sa”. 

(b) Consider the series 


[ye 


Ea —(k- 1)ze~ (#2 7 O0<a<l. 


> 
Il 


1 
Since the series is a telescoping series, the nth partial sum S;,,(a) is given by 


Sn(x) = nze-”™ 
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FIGURE 8.1 
Graphs of Si, Ss, Si6 


It is easily shown (Exercise 2(d), Section 8.1) that 
S(x) = lim S,(x) =0 for all «x € [0,1]. 
n—->oco 


The graphs of $4, Ss, Sig are given in Figure 8.1. 

We now show that the convergence is not uniform. Suppose that the se- 
quence {S,,} converges uniformly to 0 on [0,1]. Then if we take e = 1, there 
exists a positive integer n, such that 


|Sn(x) — S(x)| = Sp(x) =nae"™™ <1 


for all n > no and x € [0,1]. However, for each n € N, by the first derivative 
test S;, has a maximum at xz, = ,/1/2n with 


n 
M, = max S,(xz) =,/—. 

" 0<e<1 n(x) 2e 
This term however is greater than 1 for n > 6. Thus the convergence is not 
uniform. Since the maximum of each S, moves along the x—axis as n > 
oo, such functions are often referred to as “sliding-hump” functions. For this 
example M,, > oo as n + oo. 


The Cauchy Criterion 


Our first criterion for uniform convergence is the Cauchy criterion. The state- 
ment of this result is very similar to the definition of Cauchy sequence. 
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THEOREM 8.2.3 (Cauchy Criterion) A sequence {f,} of real-valued 
functions defined on a set E’ converges uniformly on E if and only if for 
every € > 0, there exists an integer no © N such that 


|fn(@) — fm(x)| <e (1) 
for allx € E and alln, m > no. 


Proof. If {f,} converges uniformly to f on FE, then the proof that (1) holds 
is similar to the proof that every convergent sequence is Cauchy. Conversely, 
suppose that the sequence { f,, } satisfies (1). Then for each x € EF, the sequence 
{fn(z)} is a Cauchy sequence in R, and hence converges (Theorem 3.6.5). 
Therefore, 


f(x) = lim fn(x) 


noo 
exists for every x € E. 
We now show that the sequence { f,,} converges uniformly to f on E. Let 
€ > 0 be given. By hypothesis, there exists ny € N such that (1) holds for all 
x€E andalln, m> no. Fix an m > no. Then 


IP(¢) — fon )| = lim [fn (at) — fin(2)| < € 


for all a € E. Since the above holds for all m > no, the sequence { f,, } converges 
uniformly to f on E. 


The analogous result for series is as follows: 
COROLLARY 8.2.4 The series > fx of real-valued functions on E con- 


=1 
verges uniformly on E if and only if given € > 0, there exists a positive integer 


No, such that 
SS ie) 


k=n+1 


<e 


for alla € E and all integers m > n> no. 


Proof. The proof of the Corollary follows by applying the previous theorem 
to the partial sums S,,(x) of the series }> f;,(x). 


THEOREM 8.2.5 Suppose the sequence {fn} of real-valued functions on 
the set E converges pointwise to f on E. For eachn € N, set 


Mn = sup |fn(x) — f(#)I- 
GEE 


Then {fr} converges uniformly to f on E if and only if lim M, = 0. 


Proof. Exercise 1. 
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EXAMPLES 8.2.6 (a) To illustrate the previous theorem we consider the 
sequence 
2 
Sr(z)=nae”™ , WH 2%. 


of Example 8.2.2(b). For this sequence, lim S,,(a”) = 0 for all z, 0 <a < oo. 
noo 
However, 


M, = sup S),(a) = = 
x€[0,0co) 2e 


which diverges to co . Thus the convergence is not uniform on [0, co). However, 
the sequence {,S;,} does converge uniformly to the zero function on [a, oo) for 
every fixed a > 0. (Exercise 6) 

(b) Consider the sequence {f,} of Example 8.2.2(a) given by f(a 


) = 
x”, « € [0,1]. This sequence converges pointwise to the function f(z) = 0, 0 < 
x <1, and f(1) =1. Since 


x” 0<a<l, 


\fn(2) - f(@)| = fe mes 


we have 


M, = sup |fn(x) — f(z) =1. 
x€ [0,1] 


Thus since {M,,} does not converge to zero, the sequence {f,,} does not con- 
verge uniformly to f on [0,1]. On the other hand, if 0 < a < 1 is fixed, 
then 


Since Jim a” = 0, by Theorem 8.2.5 the sequence {f,,} converges uniformly 


to the 1 fee function on [0,a] for every fixed a,0<a< 1, 


The Weierstrass M-Test 


The following theorem of Weierstrass provides a very useful test for uniform 
convergence of a series of functions. 


THEOREM 8.2.7 (Weierstrass M-Test) Suppose {f;,} is a sequence of 
real-valued functions defined on a set E, and {M;} is a sequence of real num- 
bers satisfying 


| fe(x)| < Mp, for allac E andk EN. 


If So My < oo, then X* f(a) converges uniformly and absolutely on E. 
k=1 k=1 
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Ma 


Proof. Let $;,(x“) = f(a). Then for n > m, 


> 
Il 
ma 


n 


[Sn(t)-Sm(z)l=|} So fe(e))< SO lfele)l<s SO Me. 


k=m+1 k=m-+1 k=m+1 


Uniform convergence now follows by the Cauchy Criterion. That 5>|fi,(2)| 
also converges is clear. 


EXAMPLES 8.2.8 (a) If 5> a, converges absolutely, then since |a;, cos ka| < 
|a;| for all 2 € R, by the Weierstrass M-test the series }> a, cos kx converges 
uniformly on R. Similarly for the series }* a, sin ka. In particular, the series 


[o.e) lo e) . 
cos kx sin kx 


kp’ kp? 
k=1 k=1 


p>, 


converge uniformly on R. 
Co 
(b) Consider the series )* (x/2)*. This is a geometric series that converges 
k= 


=1 
for all x € R satisfying |x| < 2. If0 <a < 2 and |2| <a, then 


Since a/2 <1 the series )>(a/2)* converges. Thus by the Weierstrass M-test, 


the series > (x/2)* converges uniformly on [—a, a] for any a, 0 <a < 2. The 
k=1 


series however does not converge uniformly on (—2,2) (Exercise 11). 


Although the Weierstrass M-test automatically implies absolute conver- 
gence, the following example shows that uniform convergence as a general 
rule does not imply absolute convergence. 


EXAMPLES 8.2.9 (a) Consider the series 


S-( is 0<a<l1 
k=1 


For each k € N, set a, (x) = x*/k. For x € [0,1], we have 


ay(a) > ag(x) > +--+ > 0, and jim ay(x) = 0. 
00 


Thus by Theorem 7.2.3, the series }*>(—1)*+!a,(a) converges for all x € [0, 1]. 
Let 


[oe) 


S(x) = So (-1)**ta4(2). 


k+1 
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If S,,(x) is the nth partial sum of the series, then by Theorem 7.2.4 


|S) — S(t) < angi (a) < — 


SF, for all x € [0,1]. 


Thus {S,,} converges uniformly to S on [0,1]. However, the given series does 
not converge absolutely when x = 1. The series )>(—1)*t1!2*/k, x € [0,1], 


also provides an example of a series that converges uniformly on [0, 1] but for 
which the Weierstrass M-test fails. 
(b) The converse is also false; absolute convergence need not imply uniform 
Co 
convergence! As an example, consider the series )> 2?(1 + x7)~* of Example 


k=1 
8.1.2(b). Since all the terms are nonnegative, the series converges absolutely 


to 
0, x=0, 
Oa 
14+ 2%, x #0, 


on R. However, as a consequence of Corollary 8.3.2 of the next section, since 
f is not continuous at 0, the convergence cannot be uniform on any interval 
containing 0. 


Exercises 8.2 


1. Prove Theorem 8.2.5. 


2. a.lf{fn} and {g,} converge uniformly on a set E, prove that {fn + gn} 
converges uniformly on EF. 


*b. If {fn} and {gn} converge uniformly on a set EF, and if in addition 
there exist constants M and N such that |fn(x)| < M and |gn(x)| < N 
for all n € N and all x € FE, prove that {fngn} converges uniformly on EL. 


c. Find examples of sequences {fn} and {gn} that converge uniformly 
on a set E, but for which {fngn} does not converge uniformly on EF. 


3. Show that if {fn} converges uniformly on (a,b) and {fn(a)} and {fn(b)} 
converge, then {fn} converges uniformly on [a, ]. 

4. *Let fn(z) =na(1—2?)", 0< 2 < 1. Show that {f,} does not converge 
uniformly to 0 on [0, 1]. 


n 


Se ae 
1+a” 


*a. Show that {f,} converges uniformly to 0 on [0, a] for anya, 0 <a< 1. 


5. Let fn(x) 


*b. Does {fn} converge uniformly on [0, 1] ? 


6. Show that the sequence {nxe~"™ } converges uniformly to 0 on [a, co) 
for every a > 0. 
7. For eachn EN, set fr(x) = a+ * sin nx, x € R. Show that the sequence 
n 


{fn} converges uniformly to f(#) = x for all x € [—a,a], a > 0. Does 
{fn} converge uniformly to f on R? 
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8. 


10. 


11. 


12: 


13. 


14. 


15. 


16. 


Show that each of the following series converge uniformly on the indicated 
interval. 


*a, So < : Pgh < 

By aaa 0<4%<c@ Dee Ds OLS CO 
oo co (<1)! 

*c, So ke B®, 1 <a <o. d. > +——., 0<4<~m. 
k=1 ha. kK+2 


Test each of the following series for uniform convergence on the indicated 


interval. ‘ 


sin 2kx £9 x 
a, a5, «LER. b. ——,,_|a| <1. 
Pa (2k ee Eel & k (Ink)? eS 
ans a) |x| <1. 
kao 2k+1 


*d. >> sin(z/k?), p> 1, |a| <2. 


k= 

ed 1 1 
*e, <a@<l. 
eS (5 ss Os@s 


Show that each of the following series converge uniformly on [a, co) for 
any a > 0, but do not converge uniformly on (0, co). 


cb 
* eee ee 
a.) aor b. 2 pe 


Show that the series S> (x/2)* does not converges uniformly on (—2, 2). 
k=1 


*If S772.) ax converges absolutely, prove that S772 axx" converges uni- 
formly on [—1, 1]. 


Let {fn} be a sequence of functions that converges uniformly to a con- 
tinuous function f on (—oo, 00). Prove that 


lim fn (x ++) = f(a) for all x € (—00, 00). 


Let {c.} be a sequence of real numbers satisfying S*|cz| < oo, and let 
{xx} be a countable subset of [a,b]. Prove that the series 


S- Cel (x — rx) 
k=1 


converges uniformly on [a,b]. Here J is the unit jump function defined in 
Definition 4.4.9. 


(Dirichlet Test for Uniform Convergence) Suppose {fx} and {gx} 
are sequences of functions on a set E satisfying 


(a) the partial sums S,(x) = >> gz(x) are uniformly bounded on E, 
k=1 


ie., there exists M > 0 such that |Sn(a)| <M for alln € N and ve EL. 
(b) f(x) > feri(v) > 0 for all k € N and a € E, and 
(c) im fx(a) = 0 uniformly on E. 

00 


Prove that 5° fx(x)gx(a) converges uniformly on EF. 


co sinkx & coskx 
*Prove that >> ——, >> —— 
kai KP 


=, kp 
k=1 = 
closed interval which does not contain an integer multiple of 27. 


(p > 0) converge uniformly on any 


352 Introduction to Real Analysis 


17. Define a sequence of functions {f,} on [0,1] by 


1 1 1 

= if’ 22 irae 
fn(z) = n’ i Qn+1 <ZS8 Qn’. 

0, elsewhere. 


Prove that 5° fn(x) converges uniformly on [0,1], but that the Weier- 
n=1 
strass M-test fails. 


18. *Let Fo be a bounded Riemann integrable function on [0,1]. For n € N, 
define F;,(x) on [0,1] by 


Riays [ Pra (Oat 


Prove that }> Fx(a#) converges uniformly on [0, 1]. 
k=0 


8.3. Uniform Convergence and Continuity 


In this section, we will prove that the limit of a uniformly convergent sequence 
of continuous functions is again continuous. Prior to proving this result, we 
first prove a stronger result that will have additional applications later. 


THEOREM 8.3.1 Suppose {fn} is a sequence of real-valued functions that 
converges uniformly to a function f on a subset E of a metric space (X,d). 
Let p be a limit point of E, and suppose that for eachn EN, 


lim fr(@) = An. 


rp 
Then the sequence {An} converges and 


a aera 


Remark. The last statement can be rewritten as 


lim ( lim fn(2)) = lim (sim ful). 


wp \n—-0o n—-+co \a—->p 


It should be noted that p is not required to be a point of E; only a limit point 
of E. 


Proof. Let « > 0 be given. Since the sequence {f,,} converges uniformly to f 
on E, there exists a positive integer n, such that 


|fn(a) — fm(w)| <e€ (2) 
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for all n,m > no and all x € E. Since (2) holds for all # € E, letting « > p 


gives 
|A, — Am| <, for all n,m > no. 


Thus {A,,} is a Cauchy sequence in R, which as a consequence of Theorem 
3.6.5 converges. Let A = im. An. 


It remains to be shown that jim f(a) = A. Again, let € > 0 be given. First, 
+p 


by the uniform convergence of the sequence {f,(a)} and the convergence of 
the sequence {A,}, there exists a positive integer m such that 


€ 
i) — fall < § 
for all x € E, and also that 
€ 
A-—Anm| < =. 
| I<3 


Since lim fim(£) = Am, there exists a 6 > 0 such that 
tp 


\fm(@) — Am| < 5 for all 2 € B,0 <d(x,p) <6. 


By the triangle inequality, 
|f(x) — Al <|f(@) — fm(®)| + |fm(2) — Am| + |Am — Al 
2 
< Ft fm(e)— Am| <€. 
Thus if x € E with 0 < d(z,p) < 6, 


If(z) -— Al <6 


ie, lim f(x) = 


xp 


COROLLARY 8.3.2 Let E be a subset of a metric space X. 


(a) If {fn} is a sequence of continuous real-valued functions on E, and if 
{fn} converges uniformly to f on E, then f is continuous on E. 


(b) If {fn} is a sequence of continuous real-valued functions on E, and if 


SS fn converges uniformly on E, then 
n=1 


n=1 


is continuous on E. 
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Proof. (a) If p € E is an isolated point, then f is automatically continuous 
at p. If p € E'isa limit point of FE, then since f,, is continuous for each n € N, 


Tim fr(@) = fn(p). 
Thus by the previous theorem, 


lim f(x) = lim fn(p) = f(p). 


Lp n—>0o 


Therefore f is continuous at p. 
(b) For the proof of (b), let 


k=1 


Then for each n € N, S;, is continuous on FE. Since {5;,} converges uniformly 
to S on E, by part (a) S is also continuous on EF. 


EXAMPLE 8.3.3 The sequence {x”}°2,, a € [0,1], of Example 8.1.2(a) 
does not converge uniformly on [0, 1] since the limit function 


0 O0<a<l, 
n= {" —_ 


is not continuous on [0, 1]. Likewise, the series 


ey | ) 0, x =0, 
ee = 
1 a 1+a27, «#0, 


k=0 


of Example 8.1.2(b) cannot converge uniformly on any interval containing 0, 
since the sum of the series is not continuous at 0. 


Dini’s Theorem! 


A natural question to ask is whether the converse of Corollary 8.3.2 is true. 
Namely, if f and f, are continuous for all n and f, — f pointwise, is the 
convergence necessarily uniform? The following example shows that this need 
not be the case. However, in Theorem 8.3.5 we will prove that with the addi- 
tional assumption that the sequence {f,,(a)} is monotone for all x, then the 
convergence is indeed uniform. 


1This topic is not required in subsequent sections and thus can be omitted on first 
reading. 
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EXAMPLE 8.3.4 As in Example 8.2.2(b), for each n € N, let 

Sin(Z) = nate", x € [0,1]. 
Then $,, is continuous on [0,1] for each n, and Jim, S;,(a) = S(x) = 0, which 


is also continuous. However, since 


pmax, Sn() = 4/55: 


by Theorem 8.2.5 the convergence cannot be uniform. 


THEOREM 8.3.5 (Dini’s Theorem) Suppose K is a compact subset of a 
metric space X and {fn} is a sequence of continuous real-valued functions on 
K satisfying, 

(a) {fn} converges pointwise on K to a continuous function f, and 

(b) fr(x) > fn4i(x) for alla e K andneN. 
Then {fn} converges uniformly to f on K. 


Proof. For each n € N let g, = f, — f. Then gy is continuous on K, g,(x) > 
9n+1(x) > 0 for all a € K and alln € N, and 


lim n(x) = 0 foreach xe K. 
Let € > 0 be given. For each n €N, let 
Ky = {x € K : gn(a) > €}. 


We first prove that K,, is closed. Let p be a limit point of K,. By Theorem 
3.1.4 there exists a sequence {x,} in K,, which converges to p. Since gy, is 
continuous and g,(x,) > € for all k EN, 


In(p) = lim gn(axp) > €. 
k-oo 


Therefore p € K,. Thus K,, is closed and as a consequence of Theorem 2.3.5 
also compact. Furthermore, since gn(#) > gn+i(«) for alla € K, 


Kni1 C Ky for all n. 
Finally, since gn (a) > 0 for each x € K, 
() Kn = 0. 
n=1 


However, by Theorem 2.3.8 this can only be the case if K,, = @ for some 
No € N. Thus for all n > no, 


0< gn(x) <e for alla € K. 


Therefore the sequence {g,,} converges uniformly to 0 on K. 
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EXAMPLE 8.3.6 We now provide an example to show that compactness is 
required. For each n € N, set 


1 


a O0<a<l. 
nz +1 


fn(x) = 


Then {f,(a)} monotonically decreases to f(a) = 0 for each x € (0,1). How- 
ever, since lim fn(z) = 1, by Theorem 8.3.1 the convergence cannot be uni- 
2 


form. 


The Space C(K)? 


We conclude this section with a brief discussion of the space C(K) of all 
continuous real-valued functions on a compact set K. If f,g € C(K) and 
c €R, then by Theorem 4.2.3 the functions f + g and cf are also continuous 
on K. Thus C(x) is a vector space over R where for the zero element we take 
the constant function 0; that is, the function given by f(x) = 0 for all a € K. 
We define a norm on C(Ix) as follows. 


DEFINITION 8.3.7 For each f € C(K), set 
Il fllu = max{|f(«) 


The quantity ||f\|u 1s called the uniform norm of f on K. 


:x2€ Kh. 


That || ||, is indeed a norm on C(K) is left to the exercises (Exercise 12). 
We now take a closer look at uniform convergence of a sequence of continuous 
real-valued functions and also introduce the concept of convergence in norm. 
We first note that a sequence { f,,} of continuous real-valued functions on K is 
nothing else but a sequence in the set C(A’). Suppose that the sequence { f,, } 
in C(i<) converges uniformly to f on K. Then by Corollary 8.3.2 the function 
f € C(K). By the definition of uniform convergence, given € > 0 there exists 
a positive integer n. such that 


|fn(a) — f(@)| <e 


for alla € K and alln > no. Since f, —f is continuous, ifn > n,, by Corollary 
4.2.9 

Il fn — fllu = max{| fn(x) — f(a): x € [a, O]} <e. 
Therefore || fn — flu < ¢€ for alln > n, 


Conversely, suppose f, fn, € C(K) satisfy the following: For each « > 0 
there exists a positive integer n, such that || f — fn|lu < € for all n > no. But 
then | f(x) — fn(x)| < € for all « € K and all n > no; ie., {fn} converges 
uniformly to f on K. This proves the following theorem. 


?This topic can also be omitted on first reading. The concept of a complete normed 
linear space (Definition 8.3.10) is only required in Section 10.9. 
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THEOREM 8.3.8 A sequence {fn} in C(K) converges uniformly to f € 
C(K) if and only if given « > 0, there exists ng € N such that ||f — fallu < € 
for alln > no. 


Using the above as motivation, we define convergence in a normed linear 
space as follows: 


DEFINITION 8.3.9 Let (X,|| ||) be a normed linear space. A sequence 
{xn} in X converges in norm if there exists x € X such that for every 
€ > 0, there exists a positive integer no such that ||x —xpy|| < € for alln > no. 
If this is the case, we say that {xp} converges in norm to x and denote this 


by x, Lx as Nn — oOo. 


From the definition it is clear that a sequence {x,,} in X converges in norm 
to x € X if and only if lim ||x, — x|| = 0. Also, as in the proof of Theorem 
n—->co 


3.1.4 if {x,} converges in norm then its limit is unique. Using the norm it 
is also possible to define what we mean by a Cauchy sequence in a normed 
linear space. 


DEFINITION 8.3.10 (a) A sequence {xn} in a normed linear space 
(X,|| ||) is a Cauchy sequence if for every « > 0 there exists a positive 
integer No such that 

I|Xn — Xml] <€ 


for all integers n,m > No. 


(b) A normed linear space (X, || ||) is complete if every Cauchy sequence 
in X converges in norm to an element of X. 


As for sequences of real numbers, every sequence {x,,} in X that converges 
in norm to x € X is a Cauchy sequence. In Theorem 3.6.5 we proved that the 
normed linear space (R,| |) is complete. The following theorem proves that 
(C(K), |] ||u) is also complete. 


THEOREM 8.3.11 If K is a compact subset of a metric space X, then the 
normed linear space (C(K),|| ||u) is complete. 


Proof. Let {f,} be a Cauchy sequence in C(K); i.e., given € > 0, there exists 
a positive integer n, such that || fn — fmllu < € for all n, m > n . But then 


|fn(x) — fm(x)| < Ilfn -— fmllu < € 


for all x € [a,b] and all n,m > n,. Thus by Theorem 8.2.3 and Corollary 
8.3.2 the sequence { f,, } converges uniformly to a continuous function f on K. 
Finally, since the convergence is uniform, given € > 0, there exists an integer 
No such that 


lfn(a) — f(x)| < € forallae kK andn> no. 
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As a consequence we have || fn — flu < € for alln > no. Therefore the sequence 
{fn} converges to f in the norm |] ||u. 


Contraction Mappings 


In Exercise 13 of Section 4.3 we defined the notion of a contractive function 
on a subset FE of R. We now extend this to normed linear spaces. 


DEFINITION 8.3.12 Let (X,|| ||) be a normed linear space. A mapping 
(function) T : X + X is called a contraction mapping (function) if there 
exists a constant c,0<c<1, such that 


P(x) — Ty) < ella — yl 


for allxz,yE XxX. 


Clearly every contraction mapping on X is continuous, in fact uniformly 
continuous on X. As in Exercise 13 of Section 4.3, we now prove that if T is a 
contraction mapping on a complete normed linear space (X, || ||), then T has 
a unique fixed point in X. 


THEOREM 8.3.13 Let (X,|| ||) be a complete normed linear space and let 
T:X > X be a contraction mapping. Then there exists a unique point x © X 
such that T(x) = a. 


Proof. Suppose T : X — X satisfies ||T(x) — T(y)|| < cla — y|| for fixed 
c,0 <c < 1, and all x,y € X. We now define a sequence {x,,} in X as 
follows: Let x) € X be arbitrary. For n € N set z, = T(ap_1). That is, 
v1 =T (ao), 2 = T(x), etc. Since 


|2n41 — Ln] = ||T (en) — T(en-1)|| < cllan — Zn-1l], 


the sequence {x,,} is a contractive sequence in X (see Definition 3.6.8). An 
argument similar to the one used for a contractive sequence in Section 3.6 


shows that 
c”™ 


tna = Fall S |z1 — oll 
1 


—c¢ 
for alln,m € N. The details are left as an exercise (Exercise 10). Since c” > 0, 
the sequence {x,,} is a Cauchy sequence in X. By completeness, the sequence 
{x,,} converges (in the norm) to some x € X. But by continuity of the mapping 
T, 


= jim toss = jim Ten) = Te), 


i.e., T(x) = a. Suppose y € X also satisfies T(y) = y. But then 
lly — «|| = |7(y) — T()|| < elly — 2]. 


Since 0 < c < 1, the above can be true if and only if ||y — z|| = 0, that is 
y =a. Thus z is unique. 
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Exercises 8.3 


1. *Show that the series )> 2(1— a)" cannot converge uniformly for 0 < 
k=0 
Mae 
2. Forn EN, let fr(z) = 2"/(1+ 2”), x € [0,1]. Prove that the sequence 
{fn} does not converge uniformly on [0, 1]. 


3. Give an example of a sequence of functions that are not continuous at 
any point but which converges uniformly to a continuous function. 


4. *Suppose that f is uniformly continuous on R. For each n € N, set 
fn(x) = f(a + +). Prove that the sequence {fn} converges uniformly to 
f on R. 


5. Let {fn} be a sequence of continuous real-valued functions that converges 
uniformly to a function f on aset E C R. Prove that lim fp(¢n) = f(a) 
n—-oo 


for every sequence {tn} C FE such that tn 9 x € E. 


6. * Let E C R and let D be a dense subset of FE. If {fn} is a sequence of 
continuous real-valued functions on FE, and if {f,} converges uniformly 
on D, prove that { f,} converges uniformly on E. (Recall that D is dense 
in E if every point of F is either a point of D or a limit point of D) 


7. Find a sequence { fn} in C[0, 1] with || fn||u = 1 such that no subsequence 
of {fn} converges (in norm) in C[0, 1]. 


8. Suppose { f,, } is a sequence of continuous functions on [a, b] that converges 
uniformly on [a.b]. For each x € [a, 6], set g(x) = sup{ fn(z)}. 
a. Prove that g is continuous on [a, 6]. 


b. Show by example that the conclusion may be false if the sequence 
{fn} converges only pointwise on [a, }]. 


9. *For each n € N and ER, set fn(x) = (1+ 2)”. Use Dini’s theorem to 
prove that the sequence {f,,} converges uniformly to e” on [a,b] for any 
fixed a,b ER. 


10. Let (X, || ||) be a normed linear space and let T : X — X be a contraction 
mapping with constant c,0 < c < 1. If {xn} is the sequence in X as 
defined in the proof of Theorem 8.3.13, prove that 


||en4m — £n|| < (c"/(1 — ©))||z1 — zoll for all n,m EN. 
11. Define T : C[0,1] > C[0,1] by (Ty)(x) = fy(dt, O0O<x<1, 
0 
y €C([0, 1], and set T? = ToT. 


*a. Prove that |(T?y)(x)| < $27|[pllu- 


b. Show that T? is a contraction mapping on C[0, 1] and thus has a fixed 
point in C[0, 1]. 


c. Prove that T has a fixed point in C[0, 1]. 
12. Prove that (C(K),|| ||.) is a normed linear space. 


13. Prove that (€?, || ||2) is a complete normed linear space. 
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8.4 Uniform Convergence and Integration 


In Example 8.1.2(c) we provided an example of a sequence of Riemann in- 
tegrable functions that converges pointwise, but for which the limit function 
is not Riemann integrable. Furthermore, in Example 8.1.2(d) we provided an 
example of a seuence of continuous function on [0, 1] for which Jim fn(x) =0 


for all x € [0,1] but for which 


n 


: 1 
if fn(a)dx = ra 


1 1 
Thus lim f fn(z) 4 f lim f,(x)dx. Hence, pointwise convergence, even if 


the limit function is Riemann integrable, is also not sufficient for the inter- 
change of limits. 


In this section, we will prove that uniform convergence of a sequence { f,, } 
of Riemann integrable functions is again sufficient for the limit function f 
to be Riemann integrable, and for convergence of the definite integrals of f,, 
to the definite integral of f. The analogous result for the Riemann-Stieltjes 
integral is left to the exercises (Exercise 2). 


THEOREM 8.4.1 Suppose fn € Ria, b] for alln € N, and suppose that the 
sequence {fn} converges uniformly to f on [a,b]. Then f € Ra, b] and 


i f(w)de = lim i ite ae 


Proof. For each n € N, set 


én = max |fn(x) — f(2)|. 


x€ [a,b] 


Since f,, > f uniformly on [a,b], by Theorem 8.2.5, lim e, = 0. Also, for all 
noo 


x € [a,b], 

Hence ‘ : — : 
fuw-wsfrsfrs | ate. (3) 

Therefore _ 


ox fr-f i < 2€n[b — a]. 
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Since €, > 0, f € Ria, b]. Also by (3), 
b 
x) ax [ fn(a) da 


tim, tle Jae = f Fle) ae 


< €n [b— al, 


and thus 


COROLLARY 8.4.2 If fy € R{a,b] for all k € N, and if 


=>) Ae, x € [a, 6), 
k=1 


where the series converges uniformly on [a,b], then f € Ria, b] and 


[s@e=> 


k=1" 


n 


Proof. Apply the previous theorem to S,(a) = S> f(x), which by Theorem 
k=1 


6.2.1 is integrable for each n € N. 


Although uniform convergence is sufficient for the conclusion of Theorem 
8.4.1; it is not necessary. For example, if f,(#) = x”, « € [0,1], then {f,} 
converges pointwise, but not uniformly, to the function 


0, O0<a<l, 
ro) |" eS 1, 


The function f € R[0, 1] and 


1 1 
lim xc" dx = lim a 0 =i f(a)dx 
n+00 Jo n>oont+l 0 
In Section 10.6, using results from the Lebesgue theory of integration, we will 
be able to prove a stronger convergence result that does not require uniform 
convergence of the sequence {f,}. However, it does require that the limit 
function f is Riemann integrable. For completeness we include a statement of 
that result at this point. 


THEOREM 8.4.3 (Bounded Convergence Theorem) Suppose f and 


fn, n EN, are Riemann integrable functions on [a,b] with lim fn(a) = f(x) 
n—->co 


for all x € [a,b]. Suppose also that there exists a positive constant M such 
that |fn(a)| < M for all x € [a,b] and alln € N. Then 


lim | “= : ” (x) de 
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It is easily checked that the sequence { f,,} on [0,1], where for each n € N 
fn(z) = x”, satisfies the hypothesis of the previous theorem. Also, since the 
limit function f is continuous except at z = 1, f € R[0, 1]. On the other hand, 
the sequence { f,,} of Example 8.1.2(d) does not satisfy the hypothesis of the 
theorem. 


Exercises 8.4 


1. *If $0 |ax| < oo, prove that 


1 loo) foe) 
i & a") Oe = i 
0 \k=0 See 


2. Let a be a monotone increasing function on [a,b]. Suppose fn € R(a) 
on [a,b] for all nm € N, and suppose that the sequence {f,} converges 
uniformly to f on [a,b]. Then f € R(a) and 


b b 
[ fea= tim f fn da. 
n—-co 


3. For each n EN, let fn(w) = na/(1+ nz), x € [0,1]. Show that the 
sequence {f,} converges ais but not atfoenaly. to an integrable 
function f on [0,1], and that 


dim f fate )de = f FC) 


4. *If f is Riemann integrable on [0,1], use the bounded convergence theo- 
rem to prove that 


1 
lim xu" f(a) dz = 


5. Let {fn} be a sequence in a Ria b] that converges uniformly to f € R{a, b]. 
For n € N set Fn( =f fu and let F(x =Jf x € [a,b]. Prove that 


{F,} converges ‘anion to F on [a,b]. 


6. *Suppose f : [0,1] + Ris continuous. Prove that lim Sflo” = f(0). 


NO 9 


7. *Let {rn} be an enumeration of the rational numbers in [0,1], and let 
f : [0,1] — R be defined by 


O08. 

fle) = Yo sell — te) 
where J is the unit jump function of Definition 4.4.9. Prove that 
f €R(0, 1). 

8. Define g on R by g(x) = x — [a], where [x] denotes the greatest integer 
function. Prove that the function 


fle) = 5 


is Riemann integrable on [0,1]. (This function was given by Riemann as 
an example of a function that is not integrable according to Cauchy’s 
definition.) 
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9. *Let g € Ria,b] and let {fn} be a sequence of Riemann integrable 
functions on [a,b] that converges uniformly to f on [a,b]. Prove that 


b b 
jim Jing = SF. 


10. *Let g be a nonnegative real-valued function on [0, 00) for which f g(x)dx 
0 


is finite. Suppose {fn} is a sequence of real-valued functions on [0, 00) 
satisfying fn € RO, c] for every c > 0 and | fn(x)| < g(x) for all x € [0, oo) 
and n € N. If the sequence {f,} converges uniformly to f on [0,c] for 
every c > 0, prove that 
lim fn(x) dx = / f(x) dx. 

0 


n—-oco 0 


11. For f € Cla, 6], define || f||1 ZF pel ae. 


a. Prove that (C[a, 6], || ||1) is a normed linear space. 
*b. Show by example that the normed linear space (C[a, 6], || ||1) is not 
complete. 


8.5 Uniform Convergence and Differentiation 


In this section, we consider the question of interchange of limits and differ- 
entiation. Example 8.1.2(e) shows that even if the sequence {f,,} converges 
uniformly to f, this is not sufficient for convergence of the sequence { f/ } 
of derivatives. Example 8.5.3 will further demonstrate very dramatically the 
failure of the interchange of limits and differentiation. There we will give an 
example of a series, each of whose terms has derivatives of all orders, that 
converges uniformly to a continuous function f, but for which f’ fails to exist 
at every point of R. Clearly, uniform convergence of the sequence {f,,} is not 
sufficient. What is required is uniform convergence of the sequence { f/ }. 


THEOREM 8.5.1 Suppose {f,} is a sequence of differentiable functions on 
[a,b]. If 

(a) {f/} converges uniformly on [a,b], and 

(b) {fn(vo)} converges for some x, € [a,b], 
then {fn} converges uniformly to a function f on [a,b], with 


f'(@) = lim f,(2). 


n—->co 


Remarks. (a) Convergence of {fn(%o)} at some x» € [a,b] is required. For 
example, if we let gn(z) = fn(x) +n, then g/,(x) = f/(a), but {gn(x)} need 
not converge for any x € [a,b]. In Exercise 1 you will be asked to show that 
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uniform convergence of {f/} is also required; pointwise convergence is not 
sufficient. 


(b) If in addition to the hypotheses we assume that f’ is continuous 
on [a,b], then a much shorter and easier proof can be provided using the 
fundamental theorem of calculus. Since f/ is continuous, by Theorem 6.3.2 


fale) = Solve) + fat 


for all « € [a,b]. The result can now be proved using Corollary 8.3.2 and 
Theorem 8.4.1. The details are left to the exercises (Exercise 2). 


Proof. Let « > 0 be given. Since {f,(a,)} converges and {f/} converges 
uniformly, there exists n, € N such that 


\fu(to) — fin(@o)| <5, forall n,m > no, (4) 


and 


Lin) — finlt)l < gaye for allt € [a,b], andall n,m>no. (5) 


Apply the mean value theorem to the functions f, — fm with n,m > no fixed. 
Then for x, y € [a,b], there exists t between x and y such that 


(fn (2) — fm) — (Fry) — f(y)! = IEE (8) — fin OM (@ — 9)I- 
Thus by (5), 


€ 


\(Ia() — fm(e)) — (Fn) Im spaple-l< ZO 
Take y = xy in (6). Then by (4) and (6), for all x € [a,b] and n, m > no, 


\fn(&) — f(x) S |fn(&) — fm(2)) — fn (@o) — fm(o))| + |fn(®o) — fm(Xo)| 
€  € 
Hence by Theorem 8.2.3 the sequence {f,,} converges uniformly on [a, b]. Let 
f(z) = lim fn(). 
It remains to be shown that f is differentiable and that 
! 4: ! 
f(x) = lim f,(«) 
for all x € [a, b]. Fix p € [a,b], and for t 4 p, t € [a, b], define 


_ fn{t) = fnlP) fO© =f) 
t—p t-p — 


gn(t) ) g(t) = 
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Then g,,(t) — g(t) for each t € [a,b], t  p, and for each n 
: _ gl 
Him gn (t) = fn (P)- 


Let E = [a,b] \ {p}. Take y = p in inequality (6). Then for all t € EF, 


€ 


—— for all > No 
2b =a)’ or alln, m>n 


lgn(t) — gm(t)| < 


Therefore {g,,} converges uniformly to g on E. Hence by Theorem 8.3.1, 


f'®)= lim g(t) = lim fh (p). 


EXAMPLE 8.5.2 To illustrate the previous theorem consider the series 


Since |2~* sinka| < 2-* for all x € R, by the Weierstrass M-test this series 
converges uniformly to a function S' on R. For n € N, let 


Then 


Since )>k2-" converges, by the Weierstrass M-test the sequence {$/,} con- 
verges uniformly on R. Thus by Theorem 8.5.1, 


co 


Sa) Slim Sa De 


noo 
k=1 


kcoskx 
Qk 


A Continuous Nowhere Differentiable Function 


We conclude this section with the following example of Weierstrass of a con- 
tinuous function which is nowhere differentiable. When this example first ap- 
peared in 1874, it astounded the mathematical community. 


EXAMPLE 8.5.3 Consider the function f on R defined by 


k 


fe) = oS (7) 
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FIGURE 8.2 
Graphs of Si, So, S3 


where a is an odd positive integer satisfying a > 37 + 2. Since 
1 
Ok? 


cos a" ra 


2k s 


the series (7) converges uniformly on R, and hence f is continuous. The 
graphs of the partial sums (with a = 13) $;(x) = cos(mx), So(x) = Si(x) + 
5 cos(137x), and $3(x) = S2(x) + z cos(13?7z) are illustrated in Figure 8.2. 

We prove that f is nowhere differentiable by showing that for each x € R, 
there exists a sequence h,, — 0 such that 


im Fle + tin) — f(a) et 
n—0o hn 
For n EN, set 
cosa’ max 
Sale) = S- 9k ’ 
k=0 
cos ak ra 
k=n 


Then for h > 0, 
f(ath)—f(a)  Spr(a@th)—Sy(x)  Rya(a +h) — Rp(x) 
— + F 
h h h 
Our first step will be to estimate 
Sn(a +h) — Sp(x) 
h 


Sequences and Series of Functions 367 


from above. By the mean value theorem, 


k k) — k 
COs a mesh) cosa’rr ka sulePRCL ON, 


for some ¢, 0 < ¢ < h. Since 


k 


| — a® x sin[a* r(x + ¢)]| < a*x, 
we obtain 
Sin(x +h) — Sn (x) 1 |cos a* r(x + h) — cosa* na 
< 
ee) were : 


We now proceed to obtain a lower estimate on the term involving R,,. To 
do so we write 
a"x =kyn+6n, 


where k,, is an integer, and —} < On < 5. Set 


1— 5b, 
a 
Since —} < On < $, we have 3 >1-6,> 4. Therefore, 
2 1 
a Sa 24". 9 
Fe (9) 


Since a*—” is odd and ky, is an integer, 
cos[a* x(a + hn)| = cos[a*—"a(ky + 1)] = (—1)*e 71. 
Also, a*rx = ak-"a" ra = a*—-"n(kn + 6n). Using the trigonometric identity 
cos(A + B) = cos A cosB—sinA sinB 
and the fact that sin(k,a*—-"7) = 0, we have 


cos a* na = cos(a*—-"kym) cos(a*—"5n77) 


= (—1)*" cos(a*—" 6,7). 
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Therefore, 


cos a" r(x + hp) — cosa*mra = (—1)*n +1 — (—1)*» cos(a*—"5,,7/) 


= (—1)**+1[1 + cos(a*—"6,7)). 


As a consequence, 


1 cosa* r(x + hn) — cosa*rax 


Ok hn 


Rr(a + hn) — Rn(x) 
Rn 


(—1)*-*1 [1 + cos a*-" 6,71] 
hn Qk 


1 3 1+cosa®—"6,7 . 1 14+ cos6,7 
Qk ~ An Qn : 


Since —} <6, < 5, cosd,m > 0. Therefore by (9) and the above, 
> ys (10) 
— Ay 2” — 32 . 


Using the reverse triangle inequality, |a + 6| > |a| — |b], we have 


f(@ + hn) = f(x) 
Rn 


Ry(a + hy) — Rn(x) 
Fa 


9 


R,(x@ + hn) — Rn(x) 
aa 


Sin (a + hn) — Sn(x) 
a 


which by (8) and (10), 


IV 
wire 
oS 
No] a 
Names 
3 
Q 
bo 
1) 5 
bo 
aS 
N|s 
Ngee 
3 


Since a/2 > 1, we obtain 


f(@ + hn) = F(x) 
Rn 


+ OO as n — 00, 


provided a is an odd positive integer satisfying 


Le., a > 3a +2. Since 7 < 3.15, we need a > 13. 


Remark. The above proof is based on the proof of a more general result given 
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in the text by E. Hewitt and K. Stromberg. There it is proved (Theorem 17.7) 


that 
k 


ee 2 cose Ta 
k=0 
has the desired property if a is an odd positive integer, and b is any real 
number with b > 1 satisfying 
a 
b 
The above function was carefully examined by G.H. Hardy [Trans. Amer. 
Math. Soc., 17 (1916), 301-325] who proved that the above f has the stated 
properties provided 1 < b<a. 


>1+3n. 


These are by no means the only examples of such functions. A slightly 
easier construction of a continuous function which is nowhere differentiable is 
given in Exercise 7. 


Exercises 8.5 


1. Forn EN, set fr(a) = «"/n, x € [0,1]. Prove that the sequence {fn} 
converges uniformly to f(x) = 0 on [0,1], that the sequence { f;,(x)} 
converges pointwise on [0, 1], but that {f/,(1)} does not converge to f’(1). 


2. *Let {fn} be a sequence of differentiable functions on [a,b] for which 
fh is continuous on [a,b] for all n € N. If {2} converges uniformly on 
[a, b], and {fn(a0)} converges for some zo € [a,b], use the fundamental 
theorem of calculus to prove that {f,} converges uniformly to a function 
f on [a,b] and that f’(x) = lim fi, (x) for all x € [a, Bj. 


3. Let {ax}Z29 be a sequence of real numbers satisfying 5> k|ax| < oo. Show 


co 

that the series 5* a,x” converges uniformly to a function f on |x| < 1 
k=0 

and that 


f'(@) = 3 kayot 
k=1 


for all x, |x| <1. 


4. *Let {fn} be a sequence of differentiable real-valued functions on (a, b) 
that converges pointwise to a function f on (a,b). Suppose the sequence 
{ f/,} converges uniformly on every compact subset of (a,b). Prove that 
f is differentiable on (a,b) and that f’(x) = lim fi,(x) for all x € (a,b). 


5. State and prove an analogue of Theorem 8.5.1 for a series of functions 
Do fe(2). 

6. Show that each of the following series converge on the indicated interval 
and that the derivative of the sum can be obtained by term by term 
differentiation of the series: 


¥a, ——,, re€(0,c b. 3 e**, x € (0,00 
Eater 70a) bE em see 
*co, Si a®, |al <1 d. >> ee e € (—oo, ov) 


co 

i 

i=) 

co 

i 

° 
rs 
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7. This exercise provides another construction of a continuous function f 
on R which is nowhere differentiable. Set g(x) = ||, -1 < # < 1, and 
extend g to R to be periodic of period 2 by setting g(x+2) = g(x). Define 
f on R by 

co 3 k is 
f(@)= 2 (4) 94a). 
k=0 
a. Prove that f is continuous on R. 


b. Fix x, € Rand m EN. Set 6m = oer ee where the sign is chosen so 
that no integer lies between 4x, and 4™(ao + 6m). Show that 


g(4" (ao + 6m)) — g(4" x0) = 0 for alln > m. 
c. Show that 


f(o + bm) = f (xo) 
dm 


Since dm — 0 as m — oo, it now follows that f’(a,) does not exist. 


1 
> oe ; 
> 58" +1) 


8.6 The Weierstrass Approximation Theorem 


In this section, we will prove the following well known theorem of Weierstrass. 


THEOREM 8.6.1 (Weierstrass) If f is a continuous real-valued function 
on [a, b], then given € > 0, there exists a polynomial P such that 


|f(2) — P(@)| <e 


for all x € |a, bJ. 


An equivalent version, and what we will actually prove, is the following: 


If f is a continuous real-valued function on [a,b], then there exists a se- 
quence {P,,} of polynomials such that 
f(x) = lim P,(2) uniformly on [a, b]. 


n—->co 


Before we prove Theorem 8.6.1, we state and prove a more fundamental 
result that will also have applications later. Prior to doing so, we need the 
following definitions. 


DEFINITION 8.6.2 A real-valued function f on R is periodic with period 
p if 
f(e+p) = f(z) for allx ER. 
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FIGURE 8.3 
Graph of a periodic function 


The canonical examples of periodic functions are the functions sinz and 
cos x, both of which are periodic of period 27. The graph of a periodic function 
of period p is illustrated in Figure 8.3. The graphs of a periodic function of 
period p on any two successive intervals of length p are identical. It is clear 
that if f is periodic of period p, then 


f(a+kp) = f(z) for all k € Z. 


Another useful property of periodic functions is as follows: 


THEOREM 8.6.3 If f is periodic of period p and Riemann integrable on 
(0, p], then f is Riemann integrable on [a,a+ p] for every a€ R, and 


[re ee [re ie 


Approximate Identities 


Proof. Exercise 2. 


DEFINITION 8.6.4 A sequence {Qn} of nonnegative Riemann integrable 
functions on [—a, a] satisfying 


(a) : Qn(t) dt =1, and 


(b) lim Q,(t) dt =0 for every 6 > 0, is called an approximate 
mFOo JL5SIEl} 


identity on [—a, a]. 
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An approximate identity {Q,,} is sometimes also referred to as a Dirac 
sequence. 


Remark. In (b), by the integral over the set {6 < |t|} we mean the integral 
over the two intervals [—a, —6] and [0, a]. 


As we will see in Theorem 8.6.5, and again in Chapter 9, approximate 
identities play a very important role in analysis. An elementary example of 
such a sequence {Q,,}°°, is as follows: 


It is easily shown that the sequence {Q,,} is an approximate identity on [—1, 1] 
(Exercise 3). Other examples will be encountered in the proof of Theorem 8.6.1 
and in the exercises, and still others when we study Fourier series. 

As a general rule, the Q, are usually taken to be even functions; i.e. 
Qn(—2) = Q,(x). The fact that the integrals over the set {t : |t] > 6} become 
small as n + oo seems to suggest that in some sense the functions themselves 
become small as n becomes large. On the other hand, since the integrals over 
[—a, a] are always 1, by property (b) of Definition 8.6.4 


6 
lim | Q,(t)dt=1 


n—-Co 5 


for every 6 > 0. This seems to indicate that the functions are concentrated 
near 0 and must become very large near 0 (see Exercise 6). The graphs of the 
first few functions Q1, Q2, and Q3 of a typical approximate identity {Q,,} are 
given in Figure 8.4. 


THEOREM 8.6.5 Let {Q,,} be an approximate identity on [—1,1], and let f 
be a bounded real-valued periodic function on R of period 2 with f € R[-1, 1]. 
FornéeN, « ER, define 


1 
aes =| fla +t)Qn(t) dt. (11) 
-1 
If f ts continuous at x € R, then 
Jim Sn(x) = f(x). 
Furthermore, if f is continuous on [—1, 1], then 


lim S,(a) = f(a) uniformly on R. 
noo 


Proof. We first note that since f is periodic and integrable on [—1, 1], f is 
integrable on every finite subinterval of R. Thus the integral in (11) is defined 
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FIGURE 8.4 
Graphs of Q1, Q2, Q3 


for all x € R. Also, since f is bounded, there exists a constant M > 0 such 
that | f(x)| < M for alla ER. 


Suppose first that f is continuous at 7 € R. By (a) of Definition 8.6.4 


f(x) = /. f(x) Qn(t) dt. 


Therefore, 
ISa(0) — Fee) =| f [9 +2) ~ Fa) Qn(0a 


< f [Me+1)- F@1Qn ae. (12) 


-1 


Let € > 0 be given. Since f is continuous at x, there exists a 6 > 0 such that 
€ 
Ife +8) -F@l<§ 


for all t, |t] < 6. Therefore 


6 é } é 1 
[ \ero-r@lama<§ f amass | auiyat= 
On the other hand, 
[ Wero-F@lanwmasa f Quiet 
{5<|t]} 


{5<|t|} 
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Since {Q,,} is an approximate identity, by property (b) there exists no € N 


such that 
€ 
Qn(t) dt << — 
= @) 4M 


for alln > no. Thus if n > no, 
€ 
i fle +t) — F@)Qu(t) at < §. 
{5<]t]} 


Therefore by (12) and the above, 
6 
ISn(2) — FC) < fh fle+)- F@)IQn(t) at 


+f Lf (a +t) — f(x)|Qn(t) at 
{5<|t]} 


for alln > n,. Thus lim S,(x) = f(z). 
noo 
Suppose f is continuous on [—1,1]. Since f is periodic, this implies that 
f(-—1) = f(1). By Theorem 4.3.4, f is uniformly continuous on [—1, 1], and 
hence by periodicity, also on R (Exercise 1). Thus given € > 0, there exists a 


6 > 0 such that 2 


If@+t)- f@l<§ 


for all  € R and all t, |¢| < 6. As a consequence, inequality (13) holds for all 
x €R. Therefore, as above, there exists ng € N such that 


ISn(x) — fl@)| <« 


for all « € R and all n > ny. This proves that the sequence {S,,} converges 
uniformly to f on R. 


Proof of the Weierstrass Approximation Theorem. We now 
use Theorem 8.6.5 to prove the Weierstrass approximation theorem (Theorem 
8.6.1). Suppose f is a continuous real-valued function on [a,b]. By making a 
change of variable, i.e., 


g(a) = f((b-aje+a), xe [0,1], 
we can assume that f is continuous on [0,1]. Also, if we let 
g(a) = f(x) — f(0)-a[f)— fO)], wv € [0,1], 


then g(0) = g(1) = 0 and g(x) — f(x) is a polynomial. If we can approximate 
g by a polynomial Q and set 
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then P is also a polynomial with |f(x) — P(x)| = |g(x) — Q(a)|. Therefore, 
without loss of generality, we can assume that f is defined on (0, 1] satisfying 


Extend f to [—1,1] by defining f(x) = 0 for all x € [—1,0). Then f is 
continuous on [—1, 1]. Finally, we extend f to all of R by defining 


f(a) = f(w—2k), ke Z, 


where k € Z is chosen so that 7 — 2k € (—1,1] 

Our next step is to find an approximate identity {Q,} on [—1, 1] such that 
the corresponding functions S,, of Theorem 8.6.5 defined by equation (11) are 
polynomials. To accomplish this we let 


ODS Ela F ys 


where c,, > 0 is chosen such that 


Ui Qn(t) dt = 1. 


Thus the sequence {Q,,} satisfies hypothesis (a) of Definition 8.6.4. To show 
that it also satisfies (b) we need an estimate on the magnitude of c,. Since 


1 1 
Les, i (1 — t?)" dt = 2c, if (1 — ¢?)" dt 
-1 0 
1/vn 
OG | (1 —¢?)" dt 
0 


1/J/n 1 1 
> 2c, i (1 — nt”) dé = 2e,, (=- a 
0 n 
— ACp, 
Bn’? 
we obtain 
Cn < Vn < Vn. 


In the above we have used the inequality (1 — t?)" > 1 — n#? valid for all 
t € [0,1] (Example 1.3.2(b)). Finally, for any 6,0 <6 <1, 


Qn(t) = en(1— PY” < J/n(1 — 67)", for all t, 6 < |t] <1. 
Thus since 0 < (1 — 67) < 1, by Theorem 3.2.6(d), lim Q,(t) = 0 uniformly 


in 6 < |t| < 1. Therefore, 


lim Onttdi =O: 


merce J{5<|tl} 
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For « € [0,1], set 


P,(a) = : Fle + NQn(t) at 


This is the function S,,(a) of Theorem 8.6.5 except restricted to x € [0,1]. Let 
x € [0,1]. Since f(t) = 0 for t € [—1,0] U [1, 2], 


[ teroenas f ~ flw +O Qult) at, 


—x@ 


which by the change of variables s = t+ x gives 


P, (2) = | I(8)Qn(s— 2) ds. 


Therefore P,,(x), for x € [0,1], is a polynomial of degree less than or equal to 
2n. As a consequence of Theorem 8.6.5, 


lim P,(«) = f(x) uniformly on (0, 1], 


noo 


thereby proving the result. 


Remarks. (a) The above proof of the Weierstrass approximation theorem 
is a variation of a proof found in the text by Walter Rudin listed in the 
Bibliography. 

(b) The Weierstrass approximation theorem proves that the set of poly- 
nomials is dense in C((0,1]). A natural question is the following. Do we need 
all polynomials? Let N = {nj}72, be a stricly increasing sequence of positive 
integers, and let Py be the set of all polynomials of the form 


P(a@) = ao + aya™! + +++ + aga”. 


A very interesting result, whose proof is beyond the scope of the text, is the 
Miintz-Szasz Theorem’® as follows: The set P, is dense in C((0,1]) if and 


only if 

1 

k=1 
Hence, the set of all polynomials with even exponents is dense, whereas the 
set of all polynomials of the form 


P(2) =ao+ aya? + aon? + a3r° oe Ant 


is not. 


3A proof of the Miintz-Szasz theorem may by found in the following text by Walter 
Rudin: Real and Complex Analysis, McGraw-Hill, New York, 1966. 
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Exercises 8.6 


1. If f :R— R is periodic of period 2 and continuous on [—1, 1], prove that 
f is uniformly continuous on R. 
*Prove Theorem 8.6.3. 


3. For n EN, define Qn on [—1, 1] as follows: 
n 1 
Qn(x) = 0, 4 


Show that {Q,,} is an approximate identity on [—1, 1]. 
4. For n EN, set Qn(x) = en (1 — |2|)", x € [-1, 1]. 


<a<t 


n? 


<|2) <1. 


1 
*a. Determine cn > 0 so that [ Qn(t)dt = 1. 
st 


b. Prove that with the above choice of cn the sequence {Qn} is an 
approximate identity on [—1, 1]. 


c. Sketch the graph of Qn(x) for n = 2,4,8. 
5. For n EN, set Q,(x) = cnlale”” , x € [-1,1]. 


1 
a. Determine cn > 0 so that [ Qn(t) dt =1. 
“1 


b. Prove that with the above choice of cn the sequence {Q,,} is an ap- 
proximate identity on [—1, 1]. 


6. *If {Qn} is an approximate identity on [—1, 1], prove that 
lim sup{Qn(zx) : « € [—6, 6]} = 00 
TOO 
for every 6 > 0 


7. Let f be a continuous real-valued function on [0,1]. Prove that given 
€ > 0, there exists a polynomial P with rational coefficients such that 
| f(x) — P(x)| < € for all x € [0,1]. 


8. Suppose f is a continuous real-valued function on [0, 1] satisfying 


1 
f f(a)x" dx =0 for all n = 0,1, 2,... 
0 


Prove that f(z) = O for all x € [0,1]. (Hint: First show that 
ike f(x)P(x)dx = 0 for every polynomial P, then use the Weierstrass 


theorem to show that fe f?(«)dx = 0.) 


8.7 Power Series Expansions 


In this section, we turn our attention to the study of power series and the 
representation of functions by means of power series. Because of their special 
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nature, power series possess certain properties which are not valid for series 
of functions. We begin with the following definition. 


DEFINITION 8.7.1 Let {ax}?2, be a sequence of real numbers, and let 
cé R. A series of the form 


S/ an(x —c)* = ao + ay(@ — c) + a2(x — c)? +.3(2% —c)? +--- 
k=0 


is called a power series in (a —c). When c=0, the series is called a power 
series in x. The numbers az are called the coefficients of the power series. 


Even though the study of representation of functions by means of power 
series dates back to the mid seventeenth century, the rigorous study of con- 
vergence is much more recent. Certainly Newton and his successors were con- 
cerned with questions involving the convergence of a power series to its defin- 
ing functions. It was Cauchy however who with his formal development of 
series brought mathematical rigor to the subject. As an application of his 
root and ratio test, Cauchy was among the first to use these tests to deter- 
mine the interval of convergence of a power series. This is accomplished as 


CO 
follows: Consider a power series )> ax(a —c)*. Applying the root test to this 
k=0 


lim */|a,||2 —c|* =|a2—c| lim */|a,| = |x — cla, 
k- 00 k—-0o 


where a = jim */|ax|. Thus by Theorem 7.3.4 the series converges absolutely 
— 00 


series gives 


if alx —c| < 1, and diverges if ala —c| > 1. If a = 0, then alx — c| < 1 for all 
xER.If0<a<o, then 


1 
aje—c|<1 ifandonly if |a—cl<-—. 
a 


DEFINITION 8.7.2 Given a power series > a,(x — c)*, the radius of 
convergence RF is defined by 


Tf lim %/|an| = co we take R = 0, and if lim %/|a,| =0 we set R = oo. 


When R = 0, the power series > ax(a — c)* converges only for z = c. On 
the other hand, if R = oo, then the power series converges for all « € R. 
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Remark. If a, # 0 for all k and jim lax41|/|ax| exists, then by Theorem 
—0o 


7.1.10 the radius of convergence of > azx* is also given by 


Le i lan41| 
== lim : 
R k—00 lax| 


This formulation is particularly useful if the coefficients involve factorials. 


THEOREM 8.7.3 Given a power series )> ax(x —c)* with radius of con- 
k=0 
vergence R,0< R< oo, then the series 


(a) converges absolutely for all x with |x —c| < R, and 

(b) diverges for all x with |ja—c| > R. 

(c) Furthermore, if 0 < p< R, then the series converges uniformly for all 
x with |x —c| < p. 


Proof. Statements (a) and (b) were proved in the discussion preceding the 
statement of the theorem. Suppose 0 < p < R. Choose 6 such that p< 6 < R. 


Since i 
lim */Jax] = = 
ae 


there exists n, € N such that 


z 
B d 


1 
V |ax| < B for all k > no. 


Hence for k > ny and |x — c| < p, 


k 
lag @O*| Salo < (4) 


But (p/8) < 1 and thus )*(p/8)* < oo. Therefore by the Weierstrass M-test, 
the series converges uniformly on |a — c| < p. 


The previous theorem provides no suggestion as to what happens when 
|x — c| = R. As the following examples (with c = 0) illustrate, the series may 
either converge or diverge when |z| = R. 


EXAMPLES 8.7.4 (a) The series )*> x* has radius of convergence R = 1. 
k=0 
This series diverges at both « = 1 and —1. 


Bae ale 
(b) The series > = also has radius of convergence R = 1. In this case, 
k=1 


when x = 1 the series diverges; whereas when « = —1, the series is an alter- 
nating series that converges by Theorem 7.2.3. 
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love) k 
(c) Consider the series 5> = Again the radius of convergence is R = 1. 
k=1 


In this example, the series converges at both « = 1 and —1. 
(d) Consider the series 


Dep 32a ae are sh SNe die? 
k=0 
where 
Bh. if k is even, 
an = 
QF if k is odd. 


Hence lim */|a,| = 3, and therefore R = 1/3. The series diverges at both 
x =1/3 and « =—-1/3. 


(e) Finally, consider the series S* k!x*. Here az, = k!, and 


+ — lim (k +1) = oo. 


k-0o Ak k-0o 


Thus by Theorem 7.1.10 </|a%| 4 co, and R = 0. Therefore the power series 
converges only for x = 0. 


Abel’s Theorem 


Suppose we are given a power series )~ a,(x — c)* with radius of convergence 
R> 0. By setting 


f(z) =o a(a - 0, (14) 
k=0 


we obtain a function that is defined for all x, |a — c| < R. Functions that 
are defined in terms of a power series (as in (14)) are usually referred to as 
real analytic functions. Since the series converges uniformly for all x with 
|x —c| < p, for any p, 0 < p< R, the function f is continuous on |x — c| < p. 
Since this holds for all p < R, the function f is continuous on |x — c| < R. 
If the series (14) also converges at an endpoint, say at x = c+ R, then f is 
continuous not only in (c— R,c+ R) but also at « = c+ R. This follows from 
the following theorem of Abel. For convenience, we take c= 0 and R= 1. 


THEOREM 8.7.5 (Abel’s Theorem) Suppose f(x) = > axx" has radius 
k=0 


co 
of convergence R=1, and that >> ap converges. Then 
k=0 


xw—1- 


lim f(a) = So ag. 
k=0 
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Proof. Set s_; = 0, and for n = 0,1, 2,... let 5, = 5> ax. Then by the partial 
k=0 
summation formula (7.2.1) 


n n-1 
> Apex = So sri sy(a* — ®t) + spa” 
k=0 k=0 
n-1 
= (1-2) S- spn” + sya”. 
k=0 


Since the sequence {s,,} converges, if we let n — oo, then for all x, |z| < 1, 


f(x) =(1- 2) S- spr". 
k=0 


Let s = lim s,, and let « > 0 be given. Choose n, € N such that |s—s,| < 
n—>0o 
€/2 for all n > no. Since 


(1-2) Soa =1, || <1 
k=0 
we have for all z,0<a<1 
If(w) — 5] =|(1—2) So (sn — 8)a*| < (1-2) Sse — sla 

k=0 k=0 

< (1-2) J |se—s|+ 5(1-2) Soe? 
k=0 k=no+1 

<(-a)M+ a 


where M = Pe) |s; — s|. If we now choose 6 > 0 such that l-d <a <1 


implies that a ° 2)M < €/2, then | f(a) —s| < € for alla, 1-5 <a < 1. Thus 
lim f(x) = 


x17 


EXAMPLE 8.7.6 To illustrate Abel’s theorem, consider the series 


S> (—1)*t*. This series has radius of convergence R = 1. Furthermore, the 
k=0 

series converges to f(t) = 1/(1+t) for all t, |t| < 1. Since the convergence is 
uniform on |t| < |a|, where |x| < 1, by Corollary 8.4.2 


Co 


nite) = f° = cat [tae 


(=I aa Se DY 
k 


k=0 k=1 
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oo (_] k+1 
for all x, |z| < 1. The series S> a, has radius of convergence R = 1, 


k=1 
and also converges when x = 1. Thus by Abel’s theorem, 
oS (—1)*+1 


n2= 5° 


k=1 


=1 


1 Fe eee 
202° °3 4! J 


Differentiation of Power Series 
co 
Suppose the power series )> ax(x —c)* has radius of convergence R > 0. If 


k=0 
we differentiate the series term-by-term we obtain the new power series 


Sohal (a —c)* = Skt Vans gz —c)*. (15) 
k=0 


The obvious question to ask is, what is the radius of convergence of the dif- 
ferentiated series (15)? Furthermore, if f is defined by f(x) = » a,(x —c)*, 


|x — c| < R, does the series (15) converge to f’(a)? The answers to both of 
these questions are provided by the following theorem. 


THEOREM 8.7.7 Suppose >> a;,(x—c)* has radius of convergence R > 0, 
k=0 


and i 
f(x) =S- ax(a — 0), jc—cel < R. 
k=0 
Then 


(a) > kax(x—c)*-! has radius of convergence R, and 
(b) f’(z) = © ka,(x—c)*-1, for all x, |x —c| < R. 
k=1 


Proof. For convenience we take c = 0. Consider the differentiated series 
>> kaxx*-1. By Theorem 3.2.6, jim Wk =1, and for x £0, 
0° 


Therefore jim */k\a|*-! = |a|. By Exercise 10 of Section 3.5, for x 4 0, 
00 


lim ¢/|ax|k\a|*-! = lim ¥/lag| lim ¢/k|a|*-! 
00 k—00 k—+00 
=|z| lim ¥/|a,|. 
k—-00 
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Therefore, if R = oo, the differentiated series (15) converges for all x, and if 
0< R< o, the differentiated series converges for all x, |x| < R, and diverges 
for all x, |v| > R. Thus the radius of convergence of )> kaza*~! is also R. 
k=1 
Furthermore, for any p, 0 < p < R, by Theorem 8.7.3 the series )> kayx*~1 
converges uniformly for all x, |a| < p. Thus by Theorem 8.5.1, the series (15) 
obtained by term-by-term differentiation converges to f’(x), i-e., 


= So hae for all x, |a| < R. 
k=1 


COROLLARY 8.7.8 Suppose >> ax(x—c)* has radius of convergence R > 


k=0 
0, and 


f(x) = 5 x(a — 0), jc—cl < R. 
k=0 


Then f has derivatives of all orders in |x —c| < R, and for eachn EN, 
FO (e) = SO kk 1) (RFD) ag(e — 0)". (16) 
k=n 


In particular, 


fe) =nlan. (17) 


Proof. The result is obtained by successively applying the previous theorem 
to f, f’, f”, etc. Equation (17) follows by setting x = c in (16). 


DEFINITION 8.7.9 A real-valued function f defined on an open interval 
I is said to be infinitely differentiable on I if f\")(x) exists on I for all 
n EN. The set of infinitely differentiable functions on an open interval I is 
denoted by C(I). 


As a consequence of Corollary 8.7.8, if }> ax(a — c)* has radius of conver- 
gence R > 0 and if f is defined by f(z) = > ax(a —c)* for |x — | < R, 


then the function f is infinitely differentiable on (c— R,c+ R) and its nth 
derivative is given by (16). We illustrate this with the following example. 


EXAMPLE 8.7.10 For |z| < 1, 
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Thus by the previous corollary, 


: 2 = Shak! = (kt Det, 
(1-2) k=1 k=0 

a z= J kk 1) 2*-? = Sk +2)(8 +1)z*, 
(1-2) = a 


a= =" k=0 


Uniqueness Theorem for Power Series 


The following uniqueness result for power series is another consequence of 
Corollary 8.7.8 . 


COROLLARY 8.7.11 Suppose > ax(a—c)* and > by (x—c)* are two power 
series which converge for all x, |x —c| < R, for some R>0. Then 


Sl ax(a—0)* = So de(a—c)*,  |z-e < R, 
k=0 k=0 


if and only if ay = by for all k = 0,1, 2,.... 


Proof. Clearly, if a, = by, for all k, then the two power series are equal and 
converge to the same function. Conversely, set 


f(x) => /ax(2 —)* and g(x) => / bk (x —o)*. 
k=0 k=0 


If f(x) = g(x) for all x, |z—c| < R, then f\”) (x) = g(™ (2) for all n = 0,1,2,..., 
and all a, |a — c| < R. In particular, f((c) = g(c) for all n = 0,1,2,.... 
Thus by (17), an = bp for all n. 


Representation of a Function by a Power Series 


Up to this point we have shown that if a function f is defined by a power 
series, that is 


(vc) = >¢ ax (2 — 0), ljc—cl < R, 
k=0 


with radius of convergence R > 0, then by Corollary 8.7.8, f is infinitely differ- 
entiable on (ec — R,c+ R) and the coefficients a;, are given by a, = f‘")(c)/kl. 
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We now consider the converse question. Given an infinitely differentiable func- 


tion on an open interval J and c € I, can f be expressed as a power series in a 
neighborhood of the point c. Specifically, does there exist an € > 0 such that 


f(a) = SJ ax(a — 0)" 
k=0 


for all a, |x — c| < €, with a, = f) (c)/k! for all k = 0,1,2,... The following 
example of Cauchy shows that this is not always possible. 


EXAMPLE 8.7.12 Let f be defined on R by 


_ ee" x #0, 
f(z) = a x=0. 


Since lim e~!/*” = lim e~* =0, f is continuous at 0. For x £0, 
x—0 too 
9) eo l/e? 
/ 
f(x) = oo ca 
When xz = 0, we have 
2 
a eee cae A) Me ea 
OS eh a ch th ee 
The last step follows from l’Hospital’s rule. Thus, 
2 sq? 
 eol/s 
f'(2) = Pek | x x 0, 
0, x=0. 


By induction, it follows as above, that for each n € N, 


f(x) = oe ; e 


where P is a polynomial of degree 3n. The details are left to the exercises 

(Exercise 16). Thus the function f is infinitely differentiable on R. If there 

exists R > 0 such that f(z) = >> azz* for all 2, |x| < R, then az = 0 for all 
k=0 


k. As a consequence, f cannot be presented by a power series which converges 
to f in a neighborhood of 0. 
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Taylor Polynomials and Taylor Series 


We now consider the problem of representing a function f in terms of a power 
series in greater detail. Newton derived the power series expansion of many of 
the elementary functions by algebraic techniques or term-by-term integration. 
For example, the series expansion of 1/(1+ 2) can easily be obtained by long 
division, which upon term-by-term integration gives the power series expan- 
sion of In(1 + a). Maclaurin and Taylor were among the first mathematicians 
to use Newton’s calculus in determining the coefficients in the power series 
expansion of a function. Both realized that if a function f(x) had a power 
series expansion )>a;(a — c)*, then the coefficients a, had to be given by 


f) (c) fk. 


DEFINITION 8.7.13 Let f be a real-valued function defined on an open 
interval I, and letc € I andn €N. Suppose f(x) exists for all x € I. The 
polynomial 


n Fk) (¢ 
Ta(f.0)(@) =o (eo) 
k=0 


is called the Taylor polynomial of order n of f at the point c. If f is 
infinitely differentiable on I, the series 


20 (kK) (¢ 


is called the Taylor series of f atc. 


For the special case c = 0, the Taylor series of a function f is often referred 
to as the Maclaurin series. The first three Taylor polynomials To, T,, To, 
are given specifically by 


Ti(f.0)(a) = fl) + Ole 0) 
By(F,\(2) = fe) + le —) + 2a 6), 


The Taylor polynomial T;(f,c) is the linear approximation to f at c; that 
is, the equation of the straight line passing through (c, f(c)) with slope f’(c). 


In general, the Taylor polynomial T,, of f is a polynomial of degree less 
than or equal to n, that satisfies 


TH fc)(e) =f (e), 


for all k = 0,1,...,n. Since f((c) might possibly be zero, T, (as the next 
example shows) could very well be a polynomial of degree strictly less than n. 
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EXAMPLES 8.7.14 In the following examples we compute the Taylor series 
of several functions. At this stage nothing is implied about the convergence of 
the series to the function. 


(a) Let f(x) = sina and take c= 5. Then 


Tv 
f(z) = sins =1, 
f'(§) = cos = 0, 
r"(E)= sin 5 =e 
fOR)= — cos 5 =0 
Thus 1 
T3(f, 5 )(2) =1- Tha = z)? 


which is a polynomial of degree 2. In general, if n is odd, f™ (4) = 0, and if 
n = 2k is even, f(?*)(Z) = (—1)*. Therefore, if n is even, 


si 
Ta(f. $)(2) = Tarif 8) = opp @— 4) 


The Taylor expansion of f(x) = sinx about c= 5 is given by 


(b) For the function f(z) = e~!/*", by Example 8.7.12 
Tn(f,0)(x) = 0 for alln EN. 


Thus the Taylor series of f at c = 0 converges for all x € R; namely to the 
zero function. It however does not converge to f. 


(c) In many instances, the Taylor expansion of a given function can be 
computed from a know series. As an example, we find the Taylor series ex- 
pansion of f(a) = 1/a about c = 2. This could be done by computing the 
derivatives of f and evaluating them at c = 2. However, it would still remain 
to be shown that the given series converges to f(a). An easier method is as 
follows: We first write 
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For |w| < 1, 


k=0 
Setting w = (2 — x)/2, we have 
bt gO uate k 
SS) 9k => pear (t — 2)", 
k=0 k=0 


for all x, |a —2| < 2. By uniqueness, the given series must be the Taylor series 
of f(a) = 1/2. In this instance, the power series also converges to the function 
f(a) for all x satisfying |a — 2| < 2. 


Remainder Estimates 


To investigate when the Taylor series of a function f converges to f(x), we 
consider 

Rr(@) = Rn(f,c)(a) = f(@) — Tr(f, 6) (@). (18) 
The function R,, is called the remainder or error function between f and 
Tn(f,c). Clearly, 


f(x) = Jim, Tn(f,©)(2) if and only if Jim, Rr(f,c)(x) = 0. 


Since the Taylor polynomial T;, is the nth partial sum of the Taylor series of f, 

the Taylor series converges to f at a point z if and only if lim R,(f,c)(x) = 0. 
noo 

To emphasize this fact, we state it as a theorem. 


THEOREM 8.7.15 Suppose f is an infinitely differentiable real-valued 
function on the open interval I andc€ I. Then for x € I, 


if and only if lim R,(f,c)(x) = 0. 
n> Co 


The formula 


fle) =F) + Fole-) + LO @— 0? + 
(n) (¢ 
+ Oe oy + Ral fea)la) 


is known as Taylor’s formula with remainder. We now proceed to derive several 
formulas for the remainder term R,,. These can be used to show convergence 
of T,, to f. 
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Lagrange Form of the Remainder 


Our first result, due to Joseph Lagrange (1736-1813), is called the Lagrange 
form of the remainder. This result, sometimes also referred to as Taylor’s 
theorem, was previously proved for the special case n = 2 in Lemma 5.4.3. 


THEOREM 8.7.16 Suppose f is a real-valued function on an open interval 
I,c€ lI andn€Nn. If f(t) exists for every t € I, then for any x € I, 
there exists a ¢ between x and c such that 


R(t) = Ral f(e) =F — Oe — ey. (19) 
, (n+ 1)! 
Remark. Continuity of f+ is not required. 
Proof. Fix x € I, and let M be defined by 


f(x) =Ti(f,e)(@) + M (x — 0)". 


To prove the result we need to show that (n +1)! M = f("*+(¢) for some 
¢ between x and c. To accomplish this, set 


g(t) = f(t) -Ta(f,o(t) -M (t—0)"*3 
= R,(t)— M(t—o)"*. 


First, since T;, is a polynomial of degree less than or equal to n, 
gt) = f(t) — (n+ 1)! M. 


Also, since TMS (f, e)(c) = f)(c), k= 0,1,...,n, 


For convenience, let’s assume z > c. By the choice of M, g(x) = 0. By 
the mean value theorem applied to g on the interval |[c,z], there exits x, 
c< 2x, <x, such that 


0 = g(x) — ge) = g'(a1) (a — ©). 


Thus g'(x1) = 0 for some 21, c < 21 < x. Since g’(c) = 0, by the mean value 
theorem applied to g’ on the interval [c, 71], g’’ (a2) = 0 for some x2, c < x2 < 
xz ,. Continuing in this manner we obtain a point x,, satisfying c < rp, < 2, 
such that g")(x,) = 0. Applying the mean value theorem one more time to 
the function g\”) on the interval [c, x,], we obtain the existence of a ¢ € (can) 
such that 

o= g™ @,)-—9™(c) =9™ (Cn). 


Thus g("+(¢) = 0; ie, f(t) (C) — (n +1)!M = 0, for some ¢ between x 
and c. 
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In 8.7.20 we will give several examples to show how the remainder estimates 
may be used to prove convergence of the Taylor series to its defining function. 
In the following example we show how the previous theorem may be used to 
derive simple estimates and inequalities. 


EXAMPLES 8.7.17 (a) In this example, we use Theorem 8.7.16 with n = 2 
to approximate f(z) = /1+<2, «> —1. With c = 0 we find that 


eK 
BR 


Therefore T>(f,0)(x) = 1+ 5x — 32”, and thus 


1 1 
VIi+e=1+ 52-30" + Rola). 


By formula (19), 


oe Oe ee ee 
Tgp gg ese 


Ro(f,0)(«) 


for some ¢ between 0 and «. If « > 0, then ¢ > 0 and in this case (1+¢)~°/? < 
1. Therefore we have 


VIF a — T(f,0)(2)| < 32° 


for any x > 0. If we let x = 0.4, then To(f,0)(.4) = 1.18, and by the above 
|\/1.4 — 1.18] < 0.004, so that two decimal place accuracy is assured. In fact, 
to five decimal places V1.4 = 1.18322. 


(b) The error estimates can also be used to derive inequalities. As in the 
previous example, 


V1+a2=1+ 52 —- 30° + Ro(f,2). 
For x > 0 we have 0 < Ra(f,0)(x) < 4a. Thus 


1 1 1 1 1 
l+5a- 3a <vit+e<l+52 x 4 x 


for all x > 0. 


Integral Form of the Remainder 


Another formula for R,,(f,c) is given by the following integral form of the 
remainder. This however does require the additional hypothesis that the 
(n + 1)st derivative is Riemann integrable. 
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THEOREM 8.7.18 Suppose f is a real-valued function on an open interval 
Ice€landn EN. If f(t) exists for every t € I and is Riemann 
integrable on every closed and bounded subinterval of I, then 


1 x 
Ra(z)=Ralhllo)= 2, f FM H(e-Hrat,  zeL — 20) 
nl J 
Proof. The result is proved by induction on n. Suppose n = 1. Then 
Ri(z) = f(z) - fl - F(e(e- 4), 


which by the fundamental theorem of calculus 


=f r@a-sro f a= fr o-reole. 
From the integration by parts formula (Theorem 6.3.7) with 


u(t) = f(t) - f'(), v'(t) =1, 
w(t) = f"(t), v(t) = (t— 2), 


= frre \(t — x)d 
= i; “(a —t)f"(t) dt. 


To complete the proof, we assume that the result holds for n = k, and 
prove that this implies the result for n = k + 1. Thus assume R;(z) is given 
by (20). Then 


Rrii(2) = f(x) = Troilf, c)(x) 


we obtain 


/ “Le — Plat = LF" — F(t — 2) 


_ FO+D(6) 
= f(x) —Ty(f,¢)(x) - (sh ( yet 
f&tY(c) ; 
= R(x) — rir? _ cyt 
=a f @- aM Md Fr [word 


=H fe or — £ (Oh at 


As for the case n = 1, we again use integration by parts with 


u(t) = fOTM(t)— FOF (c) and v(t) = - 


which upon simplification gives, 


(k : D! [e ee 


Re41(x) = 
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Cauchy’s Form for the Remainder 


Under the additional assumption of continuity of f("+)) we obtain Cauchy’s 
form for the remainder as follows: 


COROLLARY 8.7.19 Let f be a real-valued function on an open interval 
I,ceélandneN. If f+ is continuous on I, then for each x € I, there 
exists a ¢ between c and x such that 


A has (2) 


n! 


Rn(x) = Rn(f,c)(x) (x —c) (a—¢)". (21) 


Proof. Since ("+") (t)(a—t)” is continuous on the interval from c to x, by the 


mean value theorem for integrals (Theorem 6.3.6), there exists a ¢ between c 
and a such that 


| FO (Na = tat = (© — 0) f*N(G) (@- 0)”. 


The result now follows by (20). 


We now compute the Taylor series for several elementary functions and 
use the previous formulas for the remainder to show that the series converges 
to the function. 


EXAMPLES 8.7.20 (a) As our first example we prove the binomial the- 
orem (Theorem 3.2.5). For n € N let f(a) = (1+ 2)", a2 ER. Since f isa 
polynomial of degree n, if k > n then f*)(x) = 0 for all x € R. Therefore by 
Theorem 8.7.16, 


f° (0) 
= 2 I x, 


By computation, f)(0) = n!/(n — k)! for k = 0,1,...,n. Therefore 


* n! 
ate!= agoa 
k=0 


The series expansion of (1+ 2)* for a € R with a < 0 is given in Theorem 
8.8.4, whereas the expansion for a > 0 is given in Exercise 7 of Section 8.8. 
For rational numbers a, the expansion of (1 + 2)* was known to Newton as 
early as 1664. 


(b) Let f(x) = sina with c= 0. Then 


k = 
f'n) = Sel coat n=2k+1, 
(—1)* sina, n = 2k. 
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Thus f‘”)(0) = 0 for all even n € N, and f‘(0) = (—1)*, whenever n = 
2k+1,k =0,1,2,.... Therefore the Taylor series of f at c= 0 is given by 


To show convergence of the series to sin we consider the remainder term 
R, (x). By Theorem 8.7.16, for each x € R there exists a ¢ such that 


for) (¢) htt, 


Ral®) = Tal 


Since | f+) (x)| < 1 for all x, we have 


By Theorem 3.2.6(f), lim |2|"*1/(n + 1)! = 0 for any a € R. As a conse- 
n> co 
quence, lim R,,(a) = 0 for all x € R, and thus 
n—->co 


oe 
sing = y @k+pi ; xceER. 
=0 


The sine function, as well as the cosine function, can be defined strictly in 
terms of power series. For further details, the reader is encouraged to look at 
Miscellaneous Exercise 3. 


(c) As our third example we derive the Taylor series for f(x) = In(1+<), 
where as in Example 6.3.5 


ne = | aa x>0, 
1 t 


denotes the natural logarithm function on (0,00). Then f(0) = In(1) = 0, and 
by the fundamental theorem of calculus f’(x) = 1/(1+a). Thus for n = 1,2,..., 


(n — 1)! 


() (7) = (—1)"+1 
fN(e) = (aye 


In particular, f(0) = (—1)"t!(n — 1)!, and the Taylor series of f at 0 


becomes 
[oe) 


Although we have already mee that this series converges to In(1+ 2) for all 
x, -1<a<1 (Example 8.7.6), we will prove this again to illustrate the use 
of the remainder formulas. 


De 
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Suppose first that 0 < x < 1. By Theorem 8.7.16, 
(—1)? 22741 


R(x) = Ath 0)(«) — (n zi 1)\(1 +4 ()rt 


for some ¢, 0 < ¢ < a. In this case, (1+ ¢) > 1, and thus 


for all x, 0< x <1. Therefore, 


lim Rp(x) = 0, for all x € [0,1]. 


noo 


We next consider the more difficult case —1 < x < 0. By the Cauchy form 
of the remainder, if —1 < x < 0, there exists ¢, x < ¢ < 0, such that 


1 n+l nn n go Ore 


Therefore, 


Consider the function y(t) defined on [a, 0] by 


_t-a 
~ 14+t! 


y(t) 


Then y’(t) = (1+ 2)/(1 +t)? which is positive on [x,0] provided x > —1. 
Therefore 
p(t) < 9(0) = -a = |x| 


for all t, x <<t <0. Thus 


a 
al < Ges 


Since |x| < 1, lim R,(x) = 0. Therefore the Taylor series converges to 
n—->co 
In(1+ <2) for allz, -l<a<ljie, 


|x|". 


co —] n+1 
ni +2)= >> CU" an, -l<a<l. 
n=1 


The Taylor expansion of In(1 + x) was first obtained in 1668 by Nicolaus 
Mercator. Newton shortly afterward also obtained the same expansion by 
term by term integration of the series expansion of 1/(1 + x) (see Example 
8.7.6). 
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(d) As our final example, we consider the natural exponential function 
E(x) = exp x which is defined as the inverse function of the natural logarithm 
function L(x) = Inw. The domain of L is (0,00) with range (—oo, 00). Since 
L'(x) = 1/z is strictly positive on (0,00), L is a strictly increasing function 
on (0,00). The inverse function E(a) is defined by 


y=E(x) ifandonlyif «=Iny. 


By the inverse function theorem (Theorem 5.2.14), E is differentiable on R 


with 
1 


~ ty 


Thus E’(#) = E(ax) for all a € R. Since Inab = Ina + Inb, it immediately 
follows that 


E'(a) = E'(L(y)) 


j =y=E(2). 


E(e+y)=E(x)E(y) and = E(-x) = —— 


Also, E(0) = 1, and by Example 6.3.5 E(1) = e, where e is Euler’s number 
defined in Example 3.3.5.. Therefore E(n) = e” for every integer n, and if r = 
m/n,m,n€ Z with n 4 0, then E(nr) = E(m) = e™. But E(nr) = (E(r))”. 
Therefore, if r € Q, 

E(r) =e". 


For arbitrary « € R we define e* by e* = E(x). This definition of e* is 
consistent with the definition given in Miscellaneous Exercise 3 of Chapter 1 
(See Exercise 17). 

Since E(x) = E(a) for all x € R, BE (0) = E(0) = 1. Thus the Taylor 
series expansion of E(x) about c = 0 is given by 
1 
pa a. 

0 


tl 


It is left as an exercise (Exercise 11) to show that this series converges to e” 
for alla € R. 


There is a more subtle question involving power series representation of 
functions which we have not touched upon. The question concerns the follow- 
ing: How is the radius of convergence R of the Taylor series of f related to the 
function f? The full answer to this question requires a knowledge of complex 
analysis and thus is beyond the scope of this text. However, we will illustrate 
the question and provide a hint of the answer with the following examples. If 
f(x) =1/(1+ 2), then the Taylor expansion of f about x = 0 is given by 
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which has radius of convergence R = 1. This is expected since the given 
function f is not defined at 2 = —1, and thus the series could not have radius 
of convergence R > 1. If it did, this would imply that f would then have a 
finite limit at « = —1. 

On the other hand, the function g(a) = 1/(1+2?) is infinitely differentiable 
on all of R. However, the Taylor series expansion of g about c = 0 is given by 
So (-1)Fa?*, 

k=0 
which again has only radius of convergence R = 1. The reason for this is that 
even though g is well behaved on R, if we extend g to the complex plane C 
by 


then g is not defined when z? = —1; ie., z = +i, where i is the complex 
number that satisfies i? = —1. 


Exercises 8.7 


1. Find the radius of convergence of each of the following power series: 


a. : as *b. - J eg 41) 

kaa 8 kao 4” 

co 1 k ies) 1 k? 
c. >> (1-3) a: > (1-z) xk 

k=1 k k=1 k 

oo a\k oo 2 when & is even, 
e. Ok (5) SES" apx* where az = a 

ka. \2 k=0 ——, when k is odd. 

DR+2 


2. For each of the following, determine all values of x for which the given 
series converges: 


Sk se 3% ak eo f1l+a 

a. —,(x# #0) *b. — |; (4§ 1) . ( 
Pay xk ( ) & ORCL =e) ( ) Pay 
3. Using the power series expansion of 1 i (1 — x) and its derivatives, find 


co 


*a, Si ka®,|a)<1  b. So ka*, [al <1. ic. re 
k=l k=l k= 2 


4. a. Use Theorem 8.7.16 to show that 


Ji +a (1452 50°) 8 


for allz > 0. 


b. Use the above inequality to approximate ¥/1.2 and */2, and provide 
an estimate of the error. 


5. Determine how large n must be chosen so that | sin x — T;,(sin,0)(x)| < 
.001 for all x, |x| < 1. 


6. Use the Taylor series and remainder estimate of Example 8.7.20(c) to 
compute In 1.2 accurate to four decimal places. 
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10. 


12. 


13. 


14. 


15. 


16. 


Suppose f(z) = >> ax(a — c)* has radius of convergence R > 0. For 


0 
jc — cl < R, set F(a) = f f(t)at. 


Prove that 
F(«) => a @—o)', wel <R. 
k=0 
; F d 
*a. Use the previous exercise and the fact that — arctanx = ———~ to 
dx 14 2? 


obtain the Taylor series expansion of arctan x about c = 0. 
b. Use part (a) to obtain a series expansion for 7. 


*c. How large must n be chosen so that the nth partial sum of the series 
in (b) provides an approximation of 7 correct to four decimal places? 
. ’ < (—1)* T 
Use Exercise 8 and Abel’s theorem to prove that >> =. 
fa0 2k +1 4 


*Find constants ao, a1, @2, a3, and a4 such that 


x! + 3x? —2¢+5 = aa(x — 1)4 +.a3(2 — 1)? +.a2(a — 1)? +1 (x — 1) +0. 


Prove that the Taylor series of e” (with c = 0) converges to e” for all 
xceER. 


Using any applicable method, find the Taylor series of each of the follow- 
ing functions at the indicated point, and specify the interval on which 
the series converges to the function 

a. f(x) =cosz, c=0. *b. f(z) =Inaz, c=1 


c. fie) =n (7*2), e=0 *d. f(z)=(1-2)-?7, c=0 


1 
oe 
e. iQ) =F 2? c=0 *f. f(w) =arcsinz, c=0 
—2 
g. f(x) = Va, c=1 *h. f(x) =(1+2)?, c=0, p real 
Suppose f(x) = > ax”, |x| < R, where R > 0. Prove the following: 
k=0 


a. f(x) is even if and only if a, = 0 for all odd k. 
b. f(a) is odd if and only if a, = 0 for all even k. 


co 
If 5 ax converges, prove that >> apn 


k=0 


converges uniformly on [0, 1]. 


Suppose f(x) = S> aza™, |x| < Ri, and g(x) = S> bea”, |x| < Re. Prove 
k=0 k=0 
that 
es) k 
f(x)g(x) = SS a*, |x| < min{R,, Ro}, where cz = D> ajby_;. 
k=0 j=0 
Let f : R > R be defined by f(x) = en?” for x # 0, and f(0) = 0. 
Prove that for each n € N, 


@ya JPA, x £0, 
f @={ A oe 
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where P is a polynomial of degree 3n. 


17. Suppose b > 1. For x € R define b(x) = E(a1nb), where E is the natural 
exponential function. 


a. Prove that b(r) = 6” for allreQ. 
b. For x € R, prove that b(x) = sup{b": r €Q,r < cz}. 


8.8 The Gamma Function 


We close this chapter with a brief discussion of the Beta and Gamma functions, 
both of which are due to Euler. The Gamma function is closely related to 
factorials and arises in many areas of mathematics. The origin, history, and 
the development of the Gamma function are described very nicely in the article 
by Philip Davis listed in the supplemental reading. Our primary application 
of the Gamma function will be in the Taylor expansion of (1 — x)~%, where 
a > 0 is arbitrary. 


DEFINITION 8.8.1 For 0 < x < oo, the Gamma function I(x) is de- 
fined by 


@y= i ihe "di, (22) 


When 0 < x < 1, the integral in (22) is an improper integral not only at oo, 
but also at 0. The convergence of the improper integral defining ['(z), x > 0, 
was given as Exercise 9 in Section 6.4. The Graph of I(x) for 0 < a < 5 is 
given in Figure 8.5. The following properties of the Gamma function show 
that it is closely related to factorials. 


THEOREM 8.8.2 (a) For each «,0<a4<o,T(a#4+1)=21T (2). 
(b) ForneN, T(n4+1)=nl. 


Proof. Let 0<c< R< o. We apply integration by parts to 


R 
- t™e~* dt. 
¢ 
With u = t® and v’ = e+, 


R 
/ tee 'dt=—-te' 
c 
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24 
22 


FIGURE 8.5 
Graph of [(a),0<a<5 


Since lim c’e~* = 0 and lim R*e~” = 0, taking the appropriate limits in 
c>0+ R- 00 
the above yields 


T(a+1)= i tie 'dt=2 | Poe dé =a l(a): 
0 0 


This proves (a). For the proof of (b) we first note that 


ra)= | etdt=1. 
0) 


Thus by induction, [(n + 1) = nl. 


EXAMPLE 8.8.3 Since the value of ['($) occurs frequently, we now show 
that ['($) = 7. By definition, 


r(4) = t2e7¢ dt. 
0 


With the substitution t = s?, 


p rtetana | e-* ds. 
0 0 


To complete the result, we need to evaluate the so-called probability integral 
f e~* ds. This can be accomplished by the following trick using the change of 


0 
variables theorem from multivariable calculus. Consider the double integral 


a | ev dady. 
0 Jo 
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By changing to polar coordinates 
x=rcos6, y=r sind, 


with 0 <r < oo, 0 € (0, §], 


Therefore, 


from which the result follows. 


The Binomial Series 


As an application of the Gamma function we will derive the power series 
expansion of f(a) = (1 — x)~%, where a > 0 is real. The coefficients of this 
expansion are expressed very nicely in terms of the Gamma function. By 
Example 8.7.10, for n € N, 


(l-a) "= : y bate 
ee) amr 
— 1 Galk+n-1)! 
c= ee 


We will now prove that this formula is still valid for all a € R with a > 0. 


THEOREM 8.8.4 (Binomial Series) For a > 0, 


a > 7a ae rn «) ie |x| ed. (23) 


n=0 
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Proof. We first show that the radius of convergence of the series (23) is R = 1. 
Set an =T(n+a)/n!. Then 
Qn41  T(nt+tl1l+a) 
Q,  (n+1)! Tinta) 


But by Theorem 8.8.2, [(n +1+a) =(n+a)I'(n +a). Therefore, 
d An+1 : nm+ra@ 
lim = lim 

nN-+0O An noo n+l 


=1 


>) 


and as a consequence of Theorem 7.1.10 we have R = 1. 
To show that the series actually converges to (1 — x)~%, we set 


i Tinta) , 
fol) = Frey oe la| <1. 


Since a power series can be differentiated term-by-term, 


j 1 Qnl(n+a vod 
fila) = oy ED a, 


n=1 


Multiplying by (1 — x) gives 


(1— ©) fa(a) 


Tr 


1 
a) 
1 


( 

Tin +a) nar ant(n+a) » 

(a) bs (n—1!~ Do saa a 

1 Co 

T(a) Dy 

But T'(n+1+a)—-—nT(n+a) =al(n+a). Therefore, 
(1 — 2) fa (©) = afa(2). 


As a consequence, 
— [(1 — 2)* fa(x)] = —a (1 — 2)** f(x) + (1 — 2) * f(x) 
=—a(1—a«)*"*f.(2) +a (1 —2)* *fa(2) = 0. 


Therefore (1—2)* fa(x) is equal to a constant for all x, |z| < 1. But f.(0) = 1. 
Thus (1 — x2)*fa(x) = 1; that is 


fo() =(1- a), 


which proves the result. 
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The Beta Function 


There are a number of important integrals that can be expressed in terms of 
the Gamma function. Some of these, which can be obtained by a change of 
variables, are given in the exercises. There is one integral however which is 
very important and thus we state it as a theorem. Since the proof is nontrivial 
and would take us too far astray, we state the result without proof. For a proof 
of the theorem the reader is referred to Theorem 8.20 in the text by Rudin. 


THEOREM 8.8.5 Forx>0,y> 0, 


: x—1 y-l -_ [(a)l(y) 
| ey d= By (24) 
The function reir 
Baw) = pe, r,y>0, 


is called the Beta function. 


Exercises 8.8 
1. *a. Compute '(3), (4). 


2n)! 
b. Prove that for n € N, [(n+4) = ( ae 


2. *By making a change of variable, prove that 


ti 1 a-l1 
(a2) = | (in *) dt, 0<4<am. 
0 


3. Evaluate each of the following definite integrals: 


re iB : 1\” 
a, | e t2dt b. if (in i) dt, neéN. 
0 0 t 


4. By making the change of variable t = sin? u in Theorem 8.8.5, prove that 
a (sin u)?”~* (cos uu)?” du = 5 ee. 


5. Evaluate each of the following integrals: 


n,m> 0. 


™ 


* eer 2n as 2n+41 

a. (sina)“"dz, neéN. b. (sin x) dz, neEN. 

0 0 

6. Use the binomial series and term-by-term integration to find the power 
series expansion of 


arcsin x = / (had? lege. 
0 


7. Let a> 0. Set (5) = 1 and for k €N set 


i.) a Cot Ce a 
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Note, if m € N, 


m m! m 
ST pe = . 
& Kaa? 4 0 fork >m 


a. Prove that the series )> & z* converges uniformly and absolutely 
k=0 
for x € [-1, 1]. 


b. Prove that 5° ({) x*® = (1+2)%, x € [-1,1]. 
k=0 


Notes 


Without question the most important concept of this chapter is that of uniform 
convergence of a sequence or series of functions. It is the additional hypothesis 
required in proving that the limit function of a sequence of continuous or integrable 
functions is again continuous or integrable. As was shown by numerous examples, 
pointwise convergence is not sufficient. For differentiation, uniform convergence of 
{fn} is not sufficient; what is also required is uniform convergence of the sequence 
of derivatives { f;,}. 

The example of Weierstrass (Example 8.5.3) is interesting for several reasons. 
First, it provides an example of a continuous function which is nowhere differentiable 
on R. Furthermore, it also provides an example of a sequence of infinitely differen- 
tiable functions which converges uniformly on R, but for which the limit function is 
nowhere differentiable. Exercise 7 of Section 8.5 provides another construction of a 
continuous function f that is nowhere differentiable. Although this construction is 
much easier, the partial sums of the series defining the function f are themselves not 
differentiable everywhere. Thus it is not so surprising that f itself is not differentiable 
anywhere on R. 

The proof of the Weiserstrass approximation theorem presented in the text is 
only one of the many poofs available. A constructive proof by S. N. Bernstein using 
the so-called Bernstein polynomials can be found on p. 107 of the text by Natanson 
listed in the Bilbiography. The proof in the text using approximate identities was 
chosen because the technique involved is very important in analysis and will be en- 
countered later in the text. In Theorem 9.4.5 we will prove a variation of the Weier- 
strass approximation theorem. At that point we will show that every continuous 
real-valued function on [—7, 7] with f(—7) = f(z) can be uniformly approximated 
to within a given ¢ by a finite sum of a trigonometric series. 
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Miscellaneous Exercises 


1. Using Miscellaneous Exercise 1 of Chapter 6 and the Weierstrass approx- 
imation theorem, prove the following: If f € R[a,b] and € > 0 is given, 
then there exists a polynomial P such that 


[r-Pise 


2. Define f on R by 


—1 
———; af 
hoe cexp (55) eS ie 
0, ja| > 1, 


where exp(z) = e”, and c > 0 is chosen so that f f(x)dx = 1. For 


—oco 


1 
A> 0, set fr(z) = x f(5o). 
a. Prove that f, € C™(R) for all \ > 0. 
b. Prove that f,(x) = 0 for all ER, |x| >A, and that f fy(x)dx = 1. 


c. Prove that for every 5>0, lim f  fy(t)dt=0. 
A>OF (5<|e]} 


3. In this exercise, we show how the trigonometric functions may be defined 
by means of power series. Define the functions S and C' on R by 


So (1) oes te? ae 
5) = oe “ c@ => ore ; 


k=0 


a. Show that the power series defining S and C' converge for all x € R. 
b. Show that $’(a) = C(x) and C’(x) = —S(a), x ER. 
c. Show that S’”(x) = —S(x) and O” (x) = —C(z). 


d. Show that if f : R — R satisfies f”(x) = —f(x) with f(0) = 0, f’(0) = 
1, then f(x) = S(x) for all x € R. 


e. If f: R—R satisfies f(x) = —f(x), prove that there exist constants 
c1, C2 such that f(x) = a S(x) + c2C(a). 

f. Show that (S(x))? + (C(a))? = 1. (Hint: Consider the function f(x) = 
(S(x))? + (C(2))?.) 

g. Show that C(a+y) = C(x)C(y)—S(x)S(y) and S(a+y) = S(a)C(y)+ 
C(x)S(y) for all z, y ER. 
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Fourier Series 


In this chapter, we consider the problem of expressing a real-valued periodic 
function of period 27 in terms of a trigonometric series 


co 
1 b,. si 
540 + ) (dn cosnax + bp sinna), 


n=1 


where the a, and 0, are real numbers. As we will see, such series afford 
much greater generality in the type of functions that can be represented as 
opposed to Taylor series. The study of trigonometric series has its origins in 
the monumental work of Joseph Fourier (1768-1830) on heat conduction in 
solids. His 1807 presentation to the French Academy introduced a whole new 
subject area in mathematics while at the same time providing very useful 
techniques for solving physical problems. 

Fourier’s work is the source of all modern methods in mathematical physics 
involving boundary value problems and has been a source of new ideas in 
mathematical analysis for the past two centuries. To see how greatly mathe- 
matics has been influenced by the studies of Fourier one only needs to look 
at the two volume work Trigonometric Series by A. Zygmund (Cambridge 
University Press, 1968). In addition to trigonometric series, Fourier’s origi- 
nal method of separation of variables leads very naturally to the study of 
orthogonal functions and the representation of functions in terms of a series 
of orthogonal functions. All of these have many applications in mathematical 
physics and engineering. 

Fourier initially claimed and tried to show, with no success, that the 
Fourier series expansion of a function actually represented the function. Al- 
though his claim is false, in view of the eighteenth century concept of a func- 
tion this was not an unrealistic expectation. Fourier’s claim had an immediate 
impact on nineteenth century mathematics. It caused mathematicians to re- 
consider the definition of “function.” The question of what type of function has 
a Fourier series expansion also led Riemann to the development of the theory 
of the integral and the notion of an integrable function. The first substantial 
progress on the convergence of a Fourier series to its defining function is due 
to Dirichlet in 1829. Instead of trying to prove like Fourier that the Fourier 
series always converged to its defining function, Dirichlet considered the more 
restrictive problem of trying to find sufficient conditions on the function f for 
which the Fourier series converges pointwise to the function. 


407 


408 Introduction to Real Analysis 


In the first section we provide a brief introduction to the theory of orthogo- 
nal functions and to the concept of approximation in the mean. In Section 9.2 
we also introduce the notion of a complete sequence of orthogonal functions 
and show that this is equivalent to the convergence in the mean of the se- 
quence of partial sums of the Fourier series to its defining function. The proof 
of the completeness of the trigonometric system {1,sinnz,cosnx}°2, will be 
presented in Section 9.4. In this section, we also prove Fejér’s theorem on the 
uniform approximation of a continuous function by the nth partial sum of a 
trigonometric series. In the final section, we present Dirichlet’s contributions 
to the pointwise convergence problem. 


9.1 Orthogonal Functions 


In this section, we provide a brief introduction to the topic of orthogonal 
functions and the question of representing a function by means of a series of 
orthogonal functions. Although these topics have their origins in the study of 
partial differential equations and boundary value problems!, they are closely 
related to concepts normally encountered in the study of vector spaces. 


If X is a vector space over R, a function (, ) : X x X —> R is an inner 
product on X if 

(a) (x,x) > 0 forallx Ee X, 

(b) (x, x) = 0 if and only if x = 0, 

(c) (x,y) = (y,x) for all x, y © X, and 

(d) (ax + by,z) = a(x,z) + b(y,z) for allx,y,z€ X anda,bER. 
In R”, the usual inner product is given by 


(a,b) = $0 ajb, 
j=l 


for a = (q,...,d,) and b = (6j,...,6,) in R”. If (, ) is an inner product on X, 
then two non-zero vectors x, y € X are orthogonal if (x,y) = 0. The term 
“orthogonal” is synonymous with “perpendicular” and comes from geometric 
considerations in R”. Two non-zero vectors a and b in R” are orthogonal if 
and only if they are mutually perpendicular; that is, the angle 6 between the 
two vectors a and b is 7/2 or 90° (see Exercise 9, Section 7.4). 

In the study of analysis we typically encounter vector spaces whose ele- 
ments are functions. For example, in previous sections we have shown that the 
space €? of square summable sequences as well as the space C[a, b] of contin- 
uous real-valued functions on [a,b] are vector spaces over R. With the usual 


1For a detailed treatment of this subject the reader is referred to the texts by Berg and 
McGregor or by Weinberger listed in the Bibliography. 
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rules of addition and scalar multiplication, R[a, b], the set of Riemann inte- 
grable functions on [a, b], is also a vector space over R. If for f, g € R[a, b] we 
define 


b 
(ta) =f #a)g(a) de. 
then it is easily shown that ( , ) satisfies (a), (c), and (d) of the definition of 


an inner product. It however does not satisfy (b). If a < b and cj,...,¢n are a 
finite number of points in [a,b], then the function 


rio) {" — 


1, r= Ci, 


is in R{a, b] satisfying (f, f) = 0, but f is not the zero function. Thus tech- 
nically (, ) is not an inner product on Ria, b], a minor difficulty which can 
easily be overcome by defining two Riemann integrable functions f and g to 
be equal if f(x) = g(x) for all x € [a,b] except on a set of measure zero. This 
will be explored in greater detail in Chapter 10. Alternately, if we restrict 
ourself to the subset C[a, b] of R[a, b], then (f,g) as defined above is an inner 
product on C[a, b] (Exercise 11). 


Orthogonal Functions 


We now define orthogonality with respect to the above inner product on 
Ra, b]. 


DEFINITION 9.1.1 A finite or countable collection of Riemann integrable 
b 
functions {¢,} on [a,b] satisfying [ ¢2, 40 is orthogonal on [a,)] if 


b 
(Ons Om) = / On(2)bm(x) dx = 0, forall nA#Am. 


EXAMPLES 9.1.2 (a) For our first example we consider the two functions 
o(x) = 1 and ¥(xz) = 2, x € [—1, 1]. Since 


a (a) b(x)dx = [. adx =0, 


the functions ¢ and w are orthogonal on the interval [—1, 1]. 


(b) In this example, we show that the sequence of functions {sinna}°2, 
is orthogonal on [—7, 7]. By the trigonometric identity 


sin Asin B = $[cos(A — B) — cos(A + B)], 
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for n 4m, 


Te 


is 1 
i: sinnz sinma dx = 5) a [cos(n — m)a — cos(n + m)a] dx 

me! 

=6 


“ —m)x  sin(n+m)a 
(n —m) (n +m) 


For future reference, when n = m, 


Tv 
/ sin? nz dx = 
— TT 


i (1 — cos 2nax) dx 


sin 2na \ |" 
a 
2n 


=i 


=T. 


Nl wl e 


(c) As our final example we consider the collection 


{ 1, sin SF cos OF} a 


on the interval [—L, LZ] where L > 0. As in (b), ifn Am, then 


L 
/ sin “* sin ** dx = 0. 
ay 5 


nTxr } 


Thus the collection {sin “F 
metric identities 


cos A cos B = $[cos(A — B) + cos(A + B)| 
sin Acos B = $[sin(A — B) +sin(A + B)], 


is orthogonal on [—L, L]. Also, by the trigono- 


we have forn 4m 


L L 

i cos "F* cos ™F* dx = / sin "F* cos ™F* dx = 0. 
-L —L 

Thus the functions in the collection {cos "F*} are all orthogonal on |—L, L] as 


are the function sin "** and cos “4 for alln, m € N with n 4 m. Form =n 


L 
= 0. 
af 


L 
NTL nae — LL g:,,2 nrz 
le sin “F* cos dx = x= sin” "FP 


NTxL 
L 


nar 


This last identity shows that the functions sin “7* and cos “= are also or- 


thogonal on [—L, L] for all n € N. Finally, since 


i L 
/ sin 4g de = | cos “* dx = 0 
af -L 


for all n € N, the constant function 1 is orthogonal to sin 4* and cos 4 * for 


all n € N. In this example, we also have 


L b 
jo sx? pac = | cos? "22 dx = L. 


—L -L 
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If in Example 9.1.2(b) we define ¢,(x) = Jz sinne, then the sequence 
{bn(x)}o@, satisfies 


"genta 


= 1, when n=™. 


{ when n#™m, 


Such a sequence of orthogonal functions is given a special name. 


DEFINITION 9.1.3 A finite or countable collection of Riemann integrable 
functions {@,} is orthonormal on [a,b] if 


b men 
/ n(x) dbm(2) de= ' whe zm, 


; when n=m. 


Given a collection {¢,} of orthogonal functions on [a,b], we can always 
construct a family {,} of orthonormal functions on [a, b] by setting 


bale) = ~ on(z), 


where c,, is defined by 


b 
B= / $2 (a) de. 


Approximation in the Mean 


Let {¢,} be a finite or countable family of orthogonal functions defined on 
an interval [a,b]. For each N € N and cj,...,cn € R, consider the Nth partial 
sum 


N 


A natural question is, given a real-valued function f on [a,b], how must the 
coefficients c,, be chosen so that Sj gives the best approximation to f on [a,b]? 
In the Weierstrass approximation theorem we have already encountered one 
form of approximation; namely uniform approximation or approximation in 
the uniform norm. However, for the study of orthogonal functions there is 
another type of norm approximation that turns out to be more useful. 


If X is a vector space over R with inner product (, ), then there is a natural 
norm on X associated with this inner product. If for x € X we define 


IIx|| = v(x, x), 


then || || is a norm on X as defined in Definition 7.4.8. The details that || || 
is a norm is left to the exercises (Exercise 12). The crucial step in proving the 
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triangle inequality for || || is the following version of the Cauchy-Schwarz 
inequality: For all x, y € X, 
I(x, ¥)1 < [xl llyll- 


The proof of this inequality follows verbatim the proo! of ae 7.4.3. For 


the vector space R{a, b] with inner product (f, g) =f f(x)g(x) dx, the norm 
of a function f, denoted || f||2, is given by 


i 1/2 
Ill = / aya | 


Thus for f € Ra, b], the natural problem to consider is how must the constants 
Cy, be chosen in order to minimize the quantity 


b 
lf — Swll2 = i [f(@) — Sv(a)|? dx? 


This type of norm approximation is referred to as approximation in the 
mean or least squares approximation. The following theorem specifies the 
choice of {c,} so that Sy provides the best approximation to f in the mean. 


THEOREM 9.1.4 Let f € Rla,b] and let {¢,} be a finite or countable 
collection of orthogonal functions on [a,b]. For N €N, let Sy be defined by 
(1). Then the quantity 


b 
/ Omri 


is minimal if and only if 


_ Ja F@)$n(2)de 
Jp 3 (aw)dex 


Furthermore, for this choice of Cn, 


[ve — 8,(«)|?dx = [ f? (x) dx — e Ve on (a) de. (3) 


Prior to proving the result, we give the following alternate statement of 
the previous theorem. 


N 
COROLLARY 9.1.5 Let f € R[a,b] and let Sn(x) = Yo Cndn(x) where 
n=1 
N 
the cy are defined by (2). If Tn (x) = au AnOn(Z), Gn €R, then 


b b 
i [F(e) - Sy(a) Pde < / [F(e) — Tw (a) Pde, 


for any choice of an, n =1,2,...,.N. 
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Proof of Theorem 9.1.4 For fixed N EN, 


b 
0< ‘A [F(e) - Sy(a) Pde 


= [ Pede—2 fsa) Sw(e)av+ f %1@) ar, (4) 


By linearity of the integral, 


n=1 a 
Also, 
N N b 
' Si (x) dx =i Sn (x) (> a) dx = se a Sn(2)bn(x) dx 
a n=1 n=1 

But 

i Sn(x)bn(x) = yo ya f k(x) On(x) da, 
which by orthogonality, 

b 
= on | 2 (x) dx 


Therefore, 


Upon substituting into (4) we obtain 
b 
0< f [F@)-Sw(e)Pde 
b N b N b 
= i: f?(x) dx — 2 Ss on f f(x) on (a) dx + s é. | b> (x) dx 
- n=1 ad n=1 o 


which upon completing the square 


2 b 2 
z fi Oe oS f eteoac |. i fee s [J se | 


Sa On 
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FIGURE 9.1 
Graphs of f and S$» 


The coefficients c, occur only in the middle term. Since this term is nonneg- 
ative, the right side is a minimum if and only if 


b 
Cn = fag te m= 1,2) cag N. 
a ge 


With this choice of c,, we also obtain formula (3) upon substitution. 


EXAMPLE 9.1.6 As was previously shown, the functions ¢,;(2) = 1 and 
é2(x) = x are orthogonal on [—1, 1]. Let f(z) = 23+ 1. Then 


Ee fase 


Cy 


and 


_Lf@erwde 3 Py 8 
PE (aya =5/ 6 +2) de ==. 


Therefore, S2(z) = 1+ 22 is the best approximation in the mean to f(x) = 
1+ 2° on [-1,1]. The graphs of f and 52 are given in Figure 9.1. 


DEFINITION 9.1.7 Let {@,}°2, be a sequence of orthogonal functions on 
[a, b] and let f € Ria, b]. For each n € N, the number 


S? f(@)on(a) dx 
Ch = 4S 5 
ff. @2 (a) dx 
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is called the Fourier coefficient of f with respect to {dn}. The series 


So cnon(x) is called the Fourier series of f. This is denoted by 


n=1 


F(x) ~ So endn(a). (6) 


Remark. The notation “~” in (6) only means that the coefficients {c,} in 
the series are given by formula (5). Nothing is implied about convergence of 
the series! 


EXAMPLE 9.1.8 In Example 9.1.2(b) it was shown that the sequence of 
functions {sinna}°, is orthogonal on [—7, 7]. Since 


Tv 
: sin? na dx = 7, HDD, eens 


TT 


if f € R[-a, a], the Fourier coefficients c,, n = 1,2,.., of f with respect to 
the orthogonal system {sinnz} are given by 


Tv 
Cn = — f(x) sinnz dx, 
us TT 


and the Fourier series of f becomes 


Co 


f(a) ~ > Cn Sin nx. 


n=1 


As indicated above, nothing is implied about convergence. Even if the series 
should converge, it need not converge to the function f. Since the terms of 
the series are odd functions of x, the series, if it converges, defines an odd 
function on [—7, 7]. Thus unless f itself is odd, the series could not converge 
to f. For example, if f(x) = 1, then 


1 /[* —1 i 
Cn = — sin nx dx = — cosnx = 0. 
T Jin nm = 


In this case, the series converges for all x, but clearly not to f(a) = 1. 


Bessel’s Inequality 


For each N EN, let Sy (x) denote the Nth partial sum of the Fourier series 
of f; i.e., 


N 
Syn (x) _ » Cndn(2), 
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where the c, are the Fourier coefficients of f with respect to the sequence 
{¢n} of orthogonal functions on [a,b]. Then by identity (3) of Theorem 9.1.4, 


b N b 
0< | P@)de—) | gn(a)de. 
: x) dx af x) dx 
Therefore ‘3 
b b 
mt Deelah Fn ae 
ms i x) dx is x) dx 


Since this holds for every N € N, by letting N — oo we obtain the following 
inequality. 


THEOREM 9.1.9 (Bessel’s Inequality) Jf f € R[a,b] and {cy}, are 
the Fourier coefficients of f with respect to the sequence of orthogonal func- 
tions {bn }°,, then 


CO Oa b 
& | B(a)ar< | Plajac. 
da [sears | re 


In Example 9.1.8 with f(x) = 1, f f?(x)dx = 2m, and c, = 0 for all 


(lB Thus it is clear that equality need not hold in Bessel’s inequality. 
However, there is one consequence of Theorem 9.1.9 which will prove useful 
later. 


COROLLARY 9.1.10 Suppose {¢,}°, is a sequence of orthogonal func- 
tions on [a,b]. If f € Ria, bl, then 


tim a L(@)bnlx) dee 


cae ay ae 


b 
Proof. Since f € R{a,)], { f?(x) dx is finite. Thus by Bessel’s inequality, the 


d b 
series ))c?, [’ 62 converges. As a consequence, 


b 


lim 2 (x) dx = 0. 


and thus 


b 
— im fa F@)bn(e) de _ e 


mee A/S. G2 (x) dx 


b 
lim cy / 2 (x) da 
n—->oco a 
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Exercises 9.1 


1. 


*Let f(x) = sina, ¢i(@) = 1, and ¢2(x) = x. Find ci and ce so that 
So(x) = ci¢i(x) + cod2(x) gives the best approximation in the mean to 
f on [-1, 1]. 

a. Show that the polynomials Po(x) = 1, Pi(x) = x, and P2(x) = 3x? — 
are orthogonal on [—1, 1]. 

b. Let 


0, -l<2<0O, 
¢)= 
F() i 0<a<1 


NIE 


Find the constants co, c,, and cz, such that S2(x) = coPo(x) +1 Pi (x) + 
c2P2(x) gives the best approximation in the mean to f on [—1, 1]. 

*a. Let do(x) = 1, o1(x) = x©— a1, b2(x) = x? — aga — a3. Determine the 
constants a1, a2, and az, so that {¢0, 1, 62} are orthogonal on [0, 1]. 
*b. Find the polynomial of degree less than or equal to 2 that best 
approximates f(x) = sin 7a in the mean on (0, 1]. 

Let {¢n}91 be a sequence of orthogonal functions on [a,b]. For f, g € 
Ra, b] with f ~ So andn and g ~ >> bndn, show that for a, 6B € R, 


co 


(af + Bg) ~ Lo (aan + Bbn)on. 


n=1 
a. Show that the sequence {sin nx}7~, is orthogonal on [0,7]. 
b. For f € R[0, 7], show that the Fourier series of f with respect to the 
sequence {sin nx} is given by 


Tw 


S> bnsinna where bp = 2 ft Fe) sin nx dx. 
n=1 T 0 


*c. Find the Fourier series of f(x) = x on [0,7] in terms of the orthogonal 
sequence {sin nz}. 
a. Show that the sequence {1,cosnx}?2, is orthogonal on [0,7]. 


b. For f € R[0, 7], show that the Fourier series of f with respect to the 
above orthogonal sequence is given by 


co 
1 
540 + ue Qn COS NX 
= 


where ao = 2 f f(x) dx and an = Z f f(x) cosna dz, n = 1,2,.... 
Lbrg T 0 
*c. Find the Fourier series of f(x) = x on [0,7] in terms of the orthogonal 


sequence {1, cosnz}. 


If f € R[0,z], prove that 


noo 


lim f f(x)sinnzdzx = lim f f(x) cosna dz = 0. 

0 n—-oo 0 
Let {¢n} be a sequence of orthogonal functions on [a,b]. If the series 
> Gn¢n(x) converges uniformly to a function f(x) on [a,b], prove that 


re. 
for each n € N, an is the Fourier coefficient of f. 
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10. 


11. 


12. 


13. 


14. 
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Let {an} be a sequence in (0,1) satisfying 0 < an41 < an < 1 for all 
n €N. Define dn on [0,1] by 


0, 0 < xL< An+1; 
2(x — an41) 1 
————— Qnt41 <U< 5 (an41 + an) 

dnl) = 4 57> ant 
n —2(ax = Gn) 1(q < < 
5 2 nt1 tan) < aU < an 

Qn — An+1 

0, Cig eg s 


Show that {¢,} is orthogonal in R[0,1] and compute ||¢n||2 for each 
neN. 
Let Po(a) = 1 and for n € N let 

1 d” 
Pa(®) = Send de 
The polynomials P,, are called the Legendre polynomials on [—1, 1]. 
a. Find P,, P2, and P3. 
b. Show that the sequence {P,,}?2o is orthogonal on [—1, 1]. (Hint: Use 
repeated integration by parts.) 


For f, g € C{a,b] define (f,g) = se f(x)g(x)dx. Prove that ( , ) is an 
inner product on C[a, }]. 


(l= 2?)",-a'e [—1) 1]: 


Let X be a vector space over R with inner product ( , ). Prove each of 
the following: 


*a. |(x,y)| < ||xl| lly] for all x, y € X. 
b. || || is a norm on X. 


(Cauchy-Schwarz Inequality) Use the previous exercise to prove that 
if f, g € Ria, b], then 


j f(e)ole)de| < (J P(2) az) ( j Pes ar) . 


Let X be a vector space over R with inner product ( , ). If {y1,...,yn} 
are non-zero orthogonal vectors in X and x € X, prove that the quantity 


|x — (c1y1 +---CnYn)|| is a minimum if and only if 
Pets yi) 

Ilysll 
or all i = 1,...,n. (Imitate the proof of Theorem 9.1.4) 


9.2 Completeness and Parseval’s Equality 


In this section, we look for necessary and sufficient conditions on the sequence 
{¢n} of orthogonal functions on [a,b] for which equality holds in Bessel’s 
inequality. To accomplish this it will be useful to introduce the notion of 


convergence in the mean. 


Fourier Series 419 


DEFINITION 9.2.1 A sequence {f,} of Riemann integrable function on 
[a,b] converges in the mean to f € Ria, }] if 


b 
tim | [f(@) — f(a) 2de = 0. 


n—->co a 


If we consider [a,b] as a normed linear space with norm 


i 1/2 
lle = / io) a | 


then convergence in the mean is nothing else but convergence in norm 

as defined in Definition 8.3.9. Thus a sequence {f,} in R[a, b] converges to 

f € Ra, b] in the mean if and only if lim || f — f,||2 = 0. Convergence in the 
n—->co 


mean is sometimes also referred to as mean-square convergence. 


It is natural to ask how convergence is the mean is related to pointwise or 
uniform convergence. Our first theorem proves that uniform convergence im- 
plies convergence in the mean. As should be expected, pointwise convergence 
is not sufficient (Exercise 2). In the other direction, we will show in Example 
9.2.3 that convergence in the mean does not imply pointwise convergence, and 
thus certainly not uniform convergence. There we construct a sequence { f;, } 
of Riemann integrable functions on [0,1] such that || f,||2 > 0, but for which 
{fn(z)} fails to converge for any x € (0, 1]. 


THEOREM 9.2.2 If f, fa, n = 1,2,...., are Riemann integrable on [a,b], 
and {fn} converges uniformly to f on [a,b], then {fn} converges in the mean 
to f on (a,b). 


Proof. Since the proof of this result is similar to the proof of Theorem 8.4.1, 
we leave it as an exercise (Exercise 1). 


EXAMPLE 9.2.3 In this example, we construct a sequence {f,} on [0, 1] 
that converges to zero in the mean, but for which {f,,(a)} does not converge 
for any x € [0,1]. This sequence is constructed as follows: For each n € N, 
write n = 2* + j where k = 0,1,2.. and 0 < j < 2*. For example, 1 = 
2° +0, 2=2'+0, 3=2'+1, etc. Define f,, on [0,1] by 


J jl 


0, otherwise. 


= 
8 

Ww 
lI 
i) 
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The first four functions fi, fo, f3, and f4 are given as follows: f(a) = 1, and 


1, O<@<§, 
pated = {1 ti a <1, 


< 
0 Os 
nied = {1 Tepe 
1 USa<4, 
Cp = 
faz) {t eal 


For each n EN, fn € RO, 1] with 


7 3 (j+1)/2* 1 
file) de = [ ldx=—. 
0 j/2* Qk 


Thus lim af f2(x) dx = 0. On the other hand, if x € [0,1], then the sequence 


{fr(x 7 dontsivis an infinite number of 0’s and 1’s, and thus does not converge. 


In the following theorem we prove that convergence in the mean of the 
partial sums of the Fourier series is equivalent to equality in Bessel’s inequality. 


THEOREM 9.2.4 Let {b,}°2, be a sequence of orthogonal functions on 
[a,b]. Then the following are cqumialent 


(a) For every f € Ra, d], 


lim | [f(x) — Sn(a)]? dx =0, 


Noo Ja 


where Sy is the Nth partial sum of the Fourier series of f. 
(b) For every f € Ria, b], 


fore) b b 
ye eo / ob? (x) dx =f f?(a) dz, (Parseval’s equality) 
n=1 a a 
where the cy are the Fourier coefficients of f. 


N 
Proof. Suppose Sy(%) = >> Cndn(x) is the Nth partial sum of the Fourier 


n=1 
series of f. Then by Theorem 9.1.4 


[ue@-sw@rae= [Pea ve [ eeas 


From this it follows immediately that {Sy} converges in the mean to f if and 
only if Parseval’s equality holds. 
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DEFINITION 9.2.5 A sequence {@n}°2, of orthogonal functions on {a, b] 
is said to be complete if for every f € R{a, dI, 


co b b 
nf @n(a)dx = f f*(a) de. 
> | x | x 


As a consequence of the previous theorem, the orthogonal sequence {¢, } 
is complete on [a, 6] if and only if for every f € Rla,b], the sequence {Sn} 
of the partial sums of the Fourier series of f converges in the mean to f. 
We now prove some additional consequences of completeness of an orthogonal 
sequence. 


THEOREM 9.2.6 If the sequence {¢,}°, of orthogonal functions on [a, b] 
is complete, and if f is a continuous real-valued function on [a,b] satisfying 


b 
/ f(x)én(x) dx = 0, for all n=1,2,..., 


then f(x) =0 for all x € [a,b]. 


Proof. The hypothesis implies that the Fourier coefficients c, of f are zero 
for all n € N. Thus by Parseval’s equality, 


[Ped=o 


Since f? is continuous and nonnegative, by Exercise 7, Section 6.1, this holds 
if and only if f?(a) = 0 for all x € [a,b]. Thus f(x) = 0 for all x € [a, J. 

There is a converse to Theorem 9.2.6. Since the proof of the converse 
requires a knowledge of the Lebesgue integral, we only state the result. A 


sketch of the proof is provided in the miscellaneous exercises (Exercise 3) of 
Chapter 10. 


THEOREM 9.2.7 If {dn }92, is a sequence of orthogonal functions on {a, b] 
having the property that the only real-valued continuous function f on [a,b] 
satisfying 


b 
/ f(z)on(x) dz =0 for all n=1,2.,... 


is the zero function, then the system {b, }°, is complete. 


For the orthogonal system {sinna}°2, on [—7,7] and f(x) = 1, we have 
Cn = O for all n = 1,2,.... Thus as a consequence of Theorem 9.2.6 the 
orthogonal system {sinnx} is not complete on [—7,7]. However, as we will 
see in Exercise 3 of Section 9.4, this system will be complete on [0,7]. 
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Another consequence of completeness is the following: Suppose {¢,,} is 
complete on [a,b] and f, g are continuous real-valued functions on [a, b] satis- 
fying 

b b 
J foen(e) ax = foe) 6n(2) de 
for alln = 1,2,..., then f(x) = g(x) for all x € [a,b]. The above assumption 
simply means that f and g have the same Fourier coefficients. To prove the 
result, apply Theorem 9.2.6 to h(x) = f(x) — g(a). 


THEOREM 9.2.8 Suppose {¢,}°2, is complete on [a,b], f, g € Ra, b] with 


f(x) ~ do endn(@) and — g(x) ~  bnGn(2). 


Then, 
b ee) b 
/ f(a)g(a) dz = N° enbn / 2 (a) dx. 
@ n=1 a 


Proof. Exercise 5. 


Exercises 9.2 


1. Prove Theorem 9.2.2. 
2. For n EN, define the function f, on [0,1] by 


Jn, 0<ar< - 
0, elsewhere. 
Show that {f,} converges to 0 pointwise, but not in the mean. 
3. Consider the orthogonal system {1, cos 7, sin 7" } 721 on [—L, L]. 


a. Show that if f € R[—L, L], then the Fourier series of f with respect 
to the above orthogonal system is given by 


f(x) ~ $40 + D> (an cos 24 + by sin 222), 


n=1 
where 
A: ate t Fahcea ae n=0,1,2 and 
| ie ie L +f =e. ? ? LAD 
L 
bn = a f(a) sin“ de, n=1,2,... 


b. Show that Bessel’s inequality becomes 


Lat D(a +R) ST f P(a)de. 
n=1 =F 
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4. *a. Assuming that the orthogonal system {sin nx} is complete on [0, x], 
show that Parseval’s equality becomes 


- = = fu }?dz where by = 2 T f(o) sinna dz. 
TO 


»? 
*b. Use Parseval’s equality and the indicated function to find the sum of 
the given series. 


iq, SS 
@ Sopp f(z) =1. (i) f(x) =a. 


*Prove Theorem 9.2.8. 
6. *Show by example that continuity of f is required in Theorem 9.2.6. 


9.3. Trigonometric and Fourier Series 


In Section 9.1, we introduced Fourier series with respect to any system 
{¢n}°2, of orthogonal functions on [a,b]. In this section, we will emphasize 
the trigonometric system 


NTL NTL YC 
ee cos “=, sin =F ee 


which by Example 9.1.2(c) is orthogonal on [—L, L]. For convenience we will 
take L = 1. 


Any series of the form 


Co 
5 Ao + An cosnz + By, sinnz), 


n=1 


where the A, and B, are real numbers, is called a trigonometric series. 
For example, the series 


Co . [oe) 
sin nx cos nx 
and ) 
Inn 


n=2 n=1 


are both examples of trigonometric series. Since the coefficients 


i a 
Inn n=2 mM n=1 


are nonnegative and decrease to zero, by Theorem 7.2.6 the first series con- 
verges for all « € R, whereas the second converges for all « € R, except 
x= 2pr, pe Z. 
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Fourier Series 
For the orthogonal system {1, cos nz, sinna}°2, on [—7, 7] we have 
Tv Tv a 
/ sin? nz dx = / cos?nadz=7, and 1? dx = 2n, 
—7T —T7 TT 
Thus by Definition 9.1.7, the Fourier coefficients of a function f € R[—7,7] 


with respect to the orthogonal system are defined as follows. 


DEFINITION 9.3.1 Let f € R[—7, 7]. The Fourier coefficients of f with 
respect to the orthogonal system {1, cosnx, sinnax} are defined by 


1 +i 
=— d. 
ao x Jy f(x) ZX, 
1 mus 
an = — f(x) cos nz dz, MSD es 
T Jez 
1 /[” . 
bn = — f(x) sin nz dx, os ey eee 
T Jz 


Also, the Fourier series of f is given by 


1 co 
f(a) ~ 30 7; S "(an cos na + by sin nz). 


n=1 


Remark. For the constant function $9 = 1, since [™ (0)? = 27, the term ao 
according to Definition 9.1.7 should be defined as x i f(a)dx. However, for 
notational convenience it is easier to define ap as + [”_ f(x)dz and to include 
the constant $ in the definition of the Fourier series. 


For the orthogonal system {1, cos na, sinnx}, by Exercise 3(b) of the pre- 
vious section, Bessel’s inequality of Theorem 9.1.9 becomes 


Co 1 via 
sagt S (a, +02) < -{ [f(x)|?de. (Bessel’s Inequality) 


Thus for f € R[a,b] the sequences {a,,} and {b,} of Fourier coefficients of 
f are square summable sequences. In Theorem 10.8.7 we will prove that if 
{an} and {b,} are square summable sequences, then there exists a Lebesgue 
integrable function f such that {a,} and {b,} are the Fourier coefficients of 
f. 

Remark on Notation. In subsequent sections we will primarily be interested 
in real-valued functions defined on all of R that are periodic of period 27. Asa 
consequence, in the examples and exercises, rather than defining our functions 
on [—7, 7], we only define the function f on [—7,7) with the convention that 

f(z) = f(—7). This then allows us to extend f to all of R as a 27 periodic 

function according to the following definition. 
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DEFINITION 9.3.2 For a real-valued function f defined on [—1,7), the 
periodic extension (of period 27) of f to R is obtained by defining f(x) = 
f(a — 2k), where k € Z is such that x — 2ka € [—7,7). 


0, —7<2z <0, 
EXAMPLES 9.3.3 (a) Let f(x) = 7S eS" Then 
1, O0<a<7 
1 /” 1 [” 
ag = — fle) de= = | ldz =1, 
T —7 Tv 0 
and for n=1,2...., 
a Ga 1 . 
an == f cosna dx = —sinnzx| =0, 
T Jo NT 0 
a ae —1 7 r 
n= = f sinna dx = —cosnx| = — [1 —cosna] = — [1 - (-1)"] 
T Jo nT 9 oT T 


In the above we have used the fact that cosna = (—1)”". Thus the Fourier 
series of f is given by 


en a — 124 1 =, 
ales Zag! (-1) eS gag ee 


If Sv(x) denotes the Nth partial sum of the Fourier series, then S; and 53 
are given by 


Si(x“) = ; + 2 sinz and S$3(x) = ; + sina + 5 sin3| . 
The graph of f, $1, $3, S5, and S$j5 are given in Figure 9.2. 

(b) Let f(x) = x. Before we compute the Fourier coefficients, we will make 
several observations which simplify this task. Recall that a function g(x) is 
even on [—a, a] if g(—x) = g(x) for all x, and g(x) is odd if g(—x) = —g(x) 
for all x. By Exercise 4 of Section 6.2, if g(x) is even on [—a, a], then 


[ s@ar=2 [a de, 


[ jee ai. 


—a 


whereas if g(a) is odd, 


The functions sin nz are all odd, whereas cos nz are even for all n. Therefore 
since f(a) = a is odd, xcosna is odd and asinnz is even. Thus, a, = 0 for 
all n = 0,1, 2,..., and 


») Tv 
bn = — | x sinnaz dz, 
) 


TT 
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FIGURE 9.2 
Graphs of f, Si, S3, Ss, and Si5 


which by an integration by parts 


2[- Od ae 2 2 
== = cosnx} + - | cosa] = ——cosnm = =(-1)"*", 
T n 0 nr 0 n nm 


Therefore 
(— 1 n+1 


co 
rn 2 ) ——_— sin nz. 
n 
n=1 


Riemann-Lebesgue Lemma 
There is one additional result from the general theory that will be needed later. 


For the orthogonal system {1, cosna, sinna}, Corollary 9.1.10 is as follows: 


THEOREM 9.3.4 (Riemann-Lebesgue Lemma) Jf f © R[—7, 7], then 
lim f(x) cosnz dx = lim f(x) sinna dx = 0. 


n-0o J noo J 


TT Tv 


The following example shows that integrability of the function f is re- 
quired. 


EXAMPLE 9.3.5 Let f be defined on [—7, 7) as follows: 


—7 <a <0, 


; O0<a“<7. 
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Then : ao a 
sin nx sin x 
f(x) sinna dx = i dz = i dx. 
—1 0 v 0 ue 
Hence, 
; me . . "™ sing © sing it~ 
lim f(x)sinna dx = lim dz = dz =~. 
n+00 J _a n+ Jo x 0 av 2 


Is a Trigonometric Series a Fourier Series? 


Since every Fourier series is a trigonometric series, an obvious question to 
ask is whether every trigonometric series is a Fourier series? More specifically, 
given a trigonometric series 


Co 
5 Ao + SS (An cosnz + By, sinnz), 


n=1 


with {A,} and {B,,} converging to zero, does there exist a function f on 
[—7,7] such that the coefficients A, and B, are given by Definition 9.3.1? 
As we will see, the answer is no! First however, in the positive direction, we 
prove the following. 


THEOREM 9.3.6 If the trigonometric series 
1 
540 + S7(An cosna + B,, sinnz) 


converges uniformly on |[—1,7], then it is the Fourier series of a continuous 
real-valued function on [—7, 7]. 


Proof. For n € N, let 


1 n 
Sn(z) = 540 + S>(Ag coskx + B, sin ka). 
k=l 


Since the series converges uniformly on [—7,7], and S;, is continuous for each 


n, 


f(x) = lim S,(z) 


n—->oco 


?The value of 7/2 for the improper integral is most easily obtained by contour integration 
and the theory of residues of complex analysis. A real variables approach that computes 
the value of this integral is given in the article by K. 5. Williams listed in the supplemental 
readings. 
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is a continuous function on [—7, 7]. For m € N, consider 


f(x) cosma dx =i ( lim Sn(2)) cosma dx 


n> co 


Since for each m, the sequence {5,,(x)cosma} converges uniformly to 
f(x) cos mz on [—7, 7], the above interchange of limits and integration is valid 
by Theorem 8.4.1. If n > m, then 


as 


S,(x) cosma = Ay [ cos Mx dx + Yo An f cos kx cos ma dx 


+ ys | sinkx cosma dx. 

k=1 mas 
Thus by orthogonality, 
/ Sin(x) cosma dx = Amt. 
Letting n — oo gives 

An = — f(x) cos ma da. 

T Jin 

The analogous formula also holds for B,,, and thus the given series is the 


Fourier series of f. 


Remarks. (a) If }>|A;| and 5>|B;,| both converge, then by the Weierstrass 
M-test the series 


1 = 
5/40 + So (Ar cos kx + B, sin ka) 
k=1 
converges uniformly on R, and thus is the Fourier series of a continuous func- 
tion on [—7, 7]. Convergence of the series 5>|Axz| and > |B,| is however not 
necessary for uniform convergence of the trigonometric series. For example, 


the trigonometric series 
co 


> sin nx 
ninn 
n=2 


le) 
converges uniformly on R (Exercise 12), yet 5° 
na. ninn 


1 
=o. 


(b) In 1903 Lebesgue proved the following stronger version of Theorem 
9.3.6: If f(z) = 4Ag + D> (Ag coska + By sinkz) for all x € (—7,7), and if f 
k=1 


mm?) 
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is continuous (in fact, measurable) then A; and B;, are the Fourier coefficients 
of the function f.° (See also Miscellaneous Exercise 1.) 


We now turn to the negative results. Consider the series 


co... 
sin nz 


Inn ’ (7) 


which by Theorem 7.2.6 converges for all « € R. However, there does not exist 
a Riemann integrable function f on [—7, 7] such that 


— =b, = — f(x) sinna dx. 


If such a function f exists, then by Bessel’s inequality we would have 


S4=Sapss| Pow 
n=2 n=2 et 


But, since f is Riemann integrable on [—7, 7], so is f?, and thus the integral 
is finite. On the other hand however, 


Y Gene 7 
(Inn)? , 


which gives a contradiction. 


The above argument only shows that the series (7) is not obtained by 
means of Definition 9.3.1 from a Riemann integrable function. There remains 
however the question whether this is still the case if we extend our definition 
to allow the class of Lebesgue integrable functions to be introduced in Chapter 
10? As we will see in Section 10.8, the answer to this is still no! 


Fourier Sine and Cosine Series 


We close this section with a brief discussion of Fourier sine and cosine series. 
As we have seen in Exercise 5 of Section 9.1, the sequence {sinnx}°°, is 
orthogonal on [0,7]. Also, by Exercise 6 of Section 9.1 the same is true of the 
sequence {1,cosnxa}°,. For f € R[0,7], the Fourier series with respect to 
each of these two orthogonal systems are called the Fourier sine and cosine 
series of f respectively. Since 


vie “us 
| sin? na dx = / cos” nx da = $n, 
0 0 


the formulas of Definition 9.1.7 give the following. 


3 Sur les series trigonometric, Annales Scientifiques de V’Ecole Normale Supérieure, (3) 
20 (1903), 453-485. 
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DEFINITION 9.3.7 For f € R[0, z], the Fourier sine series of f is given 
by 


f(a) ~ S- b, sinne, 
n=1 


where 
9 7 
in= = f f(x) sin nz dx, a a eee 
T JO 
are the Fourier sine coefficients of f. Similarly, the Fourier cosine series 
of f € RIO, ] is given by 


Co 


f(a) ~ $a0 + S- An COSN2, 


n=1 


where 
22 fF Bf 
aga=— |] f(x)dz and = aQ,=—]| f(x)cosnxdz, n=1,2.,... 
Tv 0 vi 0 
are the Fourier cosine coefficients of f. 


There is a simple connection between Fourier series and the Fourier sine 
and cosine series. As in Example 9.3.3(b), we first note that if f is an even 
function on [—7, 7], then by Exercise 1, 


Co >) 7 
f(x) ~ $a0 + ys Gn cosnxz, where a, = =| f(x) cos na dx 
T Jo 


n=1 


Similarly, if f is an odd function on [—7, 7], then 


Co ») Tv 
~ by Si , where b, = — si dx. 
f(x) S- sinnaz, where a f(x) sin nx dx 


n=1 


Thus the coefficients {a,} and {b,,} depend only on the values of the function 
f on [0,7]. Conversely, given a function f on (0,7), the following definition 
extends f both as an even and an odd function to the interval (—7, 7): 


DEFINITION 9.3.8 Let f be a real-valued function defined on [0,7). The 
even extension of f to (—1,7), denoted f., is the function defined by 


satey= {£9 —7<2<0, 


f(x), O<a<n. 


Similarly, the odd extension of f to (—a,7), denoted f,, is the function 
defined by 
—f(-2z), —7< «<0, 
fo(x) = 0, x =0, 
f(x), O<a<n. 


Fourier Series 431 


It is easily seen that the functions f.(x) and f,(a) are even and odd re- 
spectively on (—7,7), and agree with the given function f on (0,7). From 
the above discussion it is easily seen that if f € R[0, a], then the Fourier sine 
series of f is equal to the Fourier series of f,, and the Fourier cosine series of 
f is equal to the Fourier series of f, (Exercise 2). 

Remark. In the definition of the even and odd extension we only assumed 
that f was defined on [0,7), and then defined f. and f, on (—7,7). If 


f(m—) = lim_ f(e) 


LT 


exists, then for the even extension we define f.(—7) = f(a—). Thus fe is 
now defined on [—7, 7) and hence can be extended to all of R as a 27-periodic 
function. For the odd extension f,, we set f,(—7) = —f(a—), thereby defining 
fo on [—7, 7). 


Exercises 9.3 


1. Let f € R[-7, 7]. Prove the following: 
*a. If f is even on [—7, 7], then the Fourier series of f is given by 
f(z) ~ 4a9 + 43 ancosna, where an = 2 f f(x) cos na dz, 
n=1 TO 
n=0,1,2,... 
b. If f is odd on [—7, xz], then the Fourier series of f is given by 
f(x) ~ >> ba sinna where by = 2 {f(z)snnadz, n=1,2,... 
T 0 


n=1 
2. Let f € R[0, a]. Prove the following: 


a. The Fourier sine series of f is equal to the Fourier series of the odd 
extension f, of f. 


b. The Fourier cosine series of f is equal to the Fourier series of the even 
extension f. of f. 


3. Find the Fourier series of each of the following functions f on [—7,7). 


—1 —7<a2<0 0 —7T<a<0 

*a. f(x) = : = % b. f(z) =¢ ’ Mig ene 
F(@) 1, O<a<tT. F(@) x; O<a“<T. 

*c. f(x) = ||. d. f(x) = 2. 
*e. f(z) =lta. 

0, -rw<a<-, 
; ie ies 0<a<%, 

0, 7<u<t 


4. On the interval [—27, 27] sketch the graph of the 27-periodic extension 
of each of the functions in Exercise 3. 


5. Find the Fourier sine and cosine series on [0,7) of each of the following 
functions. 
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*a. f(x) =1 b. f(z) =a 
c. f(z) = 2? d. f(z) =e” 

1, O<2%<f, , _ j0, O<a< FG, 
ese={ ? ee rs) ={" Pam 


6. Let h be defined on (0,7) as follows: 

ne) =| cx, O<a<§, 

ca—-2), F<a<n, 

where c > 0 is a constant. 
a. Sketch the graph of h on [0,7). 
b. Sketch the graph of the even extension he on (—7,7). 
c. Find the Fourier series of he. 
d. Sketch the graph of the odd extension h, on (—7,7). 
e. Find the Fourier series of ho. 
7. a. Find the Fourier series of f(x) = sinz on [—7, 7]. 

*b. Find the Fourier cosine series of f(x) = sinz on [0,7]. 


8. *Suppose f, f’ are continuous on [—7,7], and f” € R[—7, 7]. Also, sup- 
pose that 
f(-m)=f(m) and f'(-m) = f(x). 
Prove that the Fourier series of f converges uniformly to f on [—7,7z]. 
(Hint: Apply integration by parts to show that |a,| and |b;,| are less than 
Ck? for some positive constant C.) 


9. Show that the trigonometric series 


cle E 
> —sinnz 
n=1 n 


converges for all x € R but is not the Fourier series of a Riemann inte- 
grable function on [—7, 7]. 


10. If f is absolutely integrable on [—7, 7] (see Section 6.4), prove that 


lim f f(x)cosnadz = lim f f(x) sinna dx =0. 
noo * noo * 


11. Using the previous exercise, show that each of the following hold. 


a. lim fInzsinnadx = lim f Inxcosnxdx = 0. 


b. lim f2x*sinnxdx = lim f x* cosnx dx =0 for all a > 1. 


12. Suppose ay > 0 for all n € N, and {nan} is monotone decreasing with 


lim nan = 0. Prove that S> an sinnx converges uniformly. (Hint: Write 
n—-oco n=1 


Yan sinna as }>(nan)(“2"") and use the fact that the partial sums of 
> sin ne are uniformly bounded. See also Exercise 15 of Section 8.2. ) 
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9.4 Convergence in the Mean of Fourier Series 


Let f be a real-valued function defined on [—7,7), and extend f to all of 
R to be periodic of period 27. Throughout this section we will assume that 
f € R[-a, 7]. Let 


1 ais : 
F(x) ~ 540 + S "(an cosna + by sin nz) 


n=1 


be the Fourier Series of f, and for each n € N, let 


1 n 
Sn (x) = gao+ So (ax cos kx + b, sin ka) 
k=1 
be the nth partial sum of the Fourier series. 


Our goal in this section will be to prove that if f € R[—7,7], then the 
sequence {S,,} converges in the mean to the function f on [—7,7]. By The- 
orem 9.2.4 this is equivalent to completeness of the trigonometric system 
{1,cosnz,sinnaz}. To investigate mean-square convergence, and also point- 
wise convergence in the next section, it will be useful to obtain an integral 
expression for Sy. 


The Dirichlet Kernel 
THEOREM 9.4.1 Let f € R[—1,7]. Then for eachn €N andz ER, 


Sy(2)=+ [ f(t)Dalw— that, 


T 
where D,, is the Dirichlet kernel, given by 


“4 1 
i. 2 sin(n + 5)t 
Dn(t) = 5 +) coskt = 2sin 4 
k=1 n+ 35, t = 2pr. 


' tA£2pr,pEZ 
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Proof. By the definition of the Fourier coefficients a;, and b;, (Definition 9.3.1), 


1 n 
Sp(x) = 500 + So (ax cos kx + by sin kx) 
k=1 
~[ F(t) dt > : © Pavese kell cos k 
— } x 
T Jin 2 ka \" Jam 
n 1 T 
+S° (=f f(t) sin kt dt) sin ka 
k=1 
4 : 1 “ . . 
-=/ f(t) = + 50 (cos kt cos ka + sin kt sin ka) dt 
ROE 2 k=1 
df? ig fe 
=— s+ k(a —t)] dt. 
tf" v0) Bok z 4 


In the last step we have used the trigonometric identity 


cos k(x — t) = coska cos kt + sin ka sin kt. 


Sa(z) = — . f(t)Dp(a — t) dt. 


To conclude the proof, it remains to derive the formula for D,,(s). If s = 2pz, 


p €Z, then 
1 n 
D,(2p7) = 3 Hee 


By identity (2) of Theorem 7.2.6, for s 4 2pz, 


eis 


Dal pat sin(n+5)s—sin§ _ sin(n+ 4)s 
te? can 2sin § ~~ Qsing 


3. 


which establishes the result. 


If the sequence {D,,}°°, were an approximate identity, convergence results 
would follow easily from Theorem 8.6.5. Unfortunately however, the functions 
D,, are neither nonnegative nor do they satisfy (b) of Definition 8.6.4. They 
however still satisfy 

1 T 
— | D,(t) dt =1, (8) 


T Jax 


a fact which will prove useful later. To see that (8) holds, it suffices to integrate 
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FIGURE 9.3 
Graphs of D,;, D3, and Ds 


the sum defining D,(s) term by term. The only nonzero term will be the 
integral involving 1/2, and thus 


1 [” 1 /" 1 
ss Dy(t)at= = | sate. 


a T Jon 


The graphs of D,, D3, and Ds are illustrated in Figure 9.3. 
The Fejér Kernel 


To prove mean-square convergence, it turns out to be more useful to first 
consider the arithmetic means of the partial sums S;,,. For each n € N, set 


Paces So(a) +--+ Sn(x) 


n+l 
By Exercise 14 of Section 3.2, if lim S,(x2) = S(x), then we also have 
noo 


Jim, On(x) = S(a). 


However, it is possible that the sequence {S,,(x)} diverges for a particular 2, 
whereas the sequence {o,,(2)} may converge. 


LEMMA 9.4.2 FornéN, let S,(x) = $a9 + >> a, cosks + by sinkax. Then 
k=l 
1 n be 
(a) o,(z) = 300 + S- (1 - 4) (a; cos jx + b; sinjx), and 


(b) | [f(2) — Sn(w)]?dx 2} [f (2) — on(a))?de. 
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FIGURE 9.4 
Graphs of F,, F3, and Fs 


Proof. The proof of (a) is left as an exercise (Exercise 1). Since o,, is itself 
the partial sum of a trigonometric series, the result (b) follows by Corollary 
9.1.5. 

Our next step is to express o,,() as an integral analogous to that of S,,(z) 
in the previous theorem. 


THEOREM 9.4.3 Let f © R[—a,7]. Then for eachn €N andx €R, 


On(x) = = ‘ f(t) Fn(a — t) dt, 


where F,, is the Fejér kernel, given by 


1 femme M8) 
— ae ,  t # 2p, 
F,,(t) = —— S > Dx (t) = 2 2(n+1) sin § 
aan ear n+l a, 
= , = 2pr. 
2 


The graphs of F,, F3, and Fs are illustrated in Figure 9.4. 
Proof. By Theorem 9.4.1, 


S,(2)=+ |” F(s)Dy(e—s)ds, 


Tv 


where D,, is the Dirichlet kernel. Therefore, 


On(x) = _ " f(s) Fn(a — s) ds, 
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where 


F,(t) = S Dy (t)- 


n+l 


If t = 2p, p € Z, then D,(2pr) = k + 3, and thus 


ti (n +1) 
F,,(2pm) = k+35)= 
(2pm) = (e+) = 4 
k=0 
If t 4 2p7, p € Z, then 
F,(s) = ey He 5)t 
a 2(n + 1) sin 5 a : 
= : : sin $sin(k + 4)t. 
2(n + 1) sin? £ rs @ ? 


By the identity sin Asin B = 5[cos(B — A) — cos(B + A)}, 


n n 


1 
Se sin § sin(k + $)t = : S "(cos kt — cos(k + 1)t) 
k=0 k=0 


1 
— 51 — cos(n + 1)t) = sin?(n + 1)8. 


Therefore, for t 4 2pz, 


F,,(t) = 


1 sin(n + 1)§ ? 
2(n +1) sin $ 
We now prove the following properties of the Fejér kernel. 


THEOREM 9.4.4 
(a) F,, is periodic of period 27 with F,(—t) = Fy (t). 
(b) F,,(t) > 0 for all t. 


(c) : f Fa(édt =1. 


(d) For0<d<z7, lim F,(t) =0 uniformly for all t, 6 < |t| <7. 
n—- Co 


Proof. (a) Clearly F,,(—t) = F;,(t). Also, since 


i (Pe a 2n)) ahs (( de 15) cos(n + 1)m 


= (-1)"""' sin («n + 05) 
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and sin s(t + 2n) = —sin §, substituting into the formula for F,, gives 
F,,(t+ 27) = F,,(t). Therefore F), is periodic of period 27. The proof of (b) is 
obvious. 


(c) Since + f Dx(t)dt = 1, we have 


=H, 


n 


1 /* ib 1. of 
— 1,(t)dt = — | D,(t) dt =1. 
=| Flo pa: w(t) at 


=0 


To prove (d), we first note that sin” £ > sin? $ for all t, 0 < 6 < |t| < 7. 


Also, since |sin(n + 1)§| < 1 for all ¢, 


L 
2 


1 


Ln 
is 2(n + 1) sin? $ 


for all t, 6 < |t| <7. 


Therefore, for any 6,0<6<7, lim F,(t) = 0 uniformly on 6 < |t| < =. 
n—->co 


As a consequence of (b), (c), and (d) above, the sequence {4F;,(t)}°2, is 
an approximate identity on [—7, 7]. If f is a real-valued function on R that is 
periodic of period 27, then 


T 


On(t)=— ff (t)Fn(a — tdt, 
which by the change of variable s = t — x, 


= ~f fls-+2)Fy(s) ds. 


Since the function s > f(s + %)F;,(s) is periodic of period 27, by Theorem 
8.6.3 


TT 


On(2) = : f(s +2)Fy(s) ds. 


TT 


Thus if f is continuous on [—7, 7] with f(—7) = f(a), by Theorem 8.6.5, 
Jim on(x) = fle) 


uniformly on [—7, 7]. We summarize this in the following theorem of L. Fejér 
(1880-1959). 


THEOREM 9.4.5 (Fejér) If f is a continuous real-valued function on 
[—1, 7] with f(—2) = f(a), then 


lim o,(x) = f(x) 


nN—-Co 


uniformly on [—1, 7]. 
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COROLLARY 9.4.6 If f is a continuous real-valued function on [—7,7] 
with f(—m) = f(m), then 


Jim ‘ [f(x) — S,(x)]? dx = 0. 


Proof. The proof of the Corollary is an immediate consequence of Lemma 
9.4.2(b). 


Remark. There is a similarity between Theorem 9.4.5 and the Weierstrass 
approximation theorem. An alternate way of expressing Theorem 9.4.5 is as 
follows: Let f be continuous on [—7,7] with f(—7) = f(a) . Given € > 0, 
there exists a trigonometric polynomial 


1 n 
Tr(x) = 50 + So (Ar cos ka + B, sin kx) 
k=l 


such that 
ey ST) se 


for all « € [—a,7]. The function T;,(a) is called a trigonometric polynomial 
since in complex form it can be rewritten as 


T(x) = ss Ee, 


k=—-n 


where by De Moivre’s formula e’** = coskx +i sin ka. 


Convergence in the Mean 


Corollary 9.4.6 only proves convergence in the mean for the case where /f is 
a continuous real-valued function on [—7, 7]. We are now ready to prove the 
main result of this section. 


THEOREM 9.4.7 If f © R[-7,7], then 


TT 


Ee a aes Sn(x)]|?dx = 0, 


where Sp, is the nth partial sum of the Fourier series of f. 


For the proof of the theorem we require the following lemma. 


LEMMA 9.4.8 Let f € Ria,b] with |f(x)| < M for all x € [a,b]. Then 
given € > 0, there exists a continuous function g on [a,b] with g(a) = g(b) and 
\g(x)| < M for all x € [a,b], such that 


b 
/ f(a) — g(a) | dx <e. 
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Before proving the lemma, we will first use the result to prove Theorem 
9.4.7, then consider some consequences of this theorem. 
Proof of Theorem 9.4.7 Suppose |f(a)| <M with M > 0, and let « > 0 
be given. By the lemma, there exists a continuous function g on [—7,7] with 
g(—7) = g() and |g(a)| < M for all x € [—a, 7] such that 


[ite se@lar < 5. (9) 


TT 


Let S,,(g)(x) be the function defined by 


Su()(2) =* [ g()Dale Ba, 


a 


where D,, is the Dirichlet kernel. Then since g is continuous, by Corollary 
9.4.6 the sequence {5;,(g)} converges in the mean to g on [—7, 7]. Thus there 
exists no € N such that 


[oo -SleyPar < $ 


f(z) — Sn(g)(@)| S [F(®) — g(@) + lg(@) — Sn(9)(@)I, 


we have 


f(x) — Sn(9)(x)? < 2 [| F(x) — 9(z)P + |9(x) — Sn(g9)(x)/7] - 
But by inequality (9), 


:. If(e) — g(a) dx <2M |” |f(a) — g(x) dz < 7 


—1 — 


Therefore, for all n > no, 


as 


J ite) -Salay(oyPae < £+2 [tole - Sula) a) dr < 


—t — 


However, for each n € N, S,,(g) is the nth partial sum of a trigonometric series. 
Thus if S,, is the nth partial sum of the Fourier series of f, by Corollary 9.1.5 


[t= Sala? aes [ple - $.(9)@P ae. 


—1 — 


Thus, given € > 0, there exists an integer n,, such that 


J 1@) - SuloP ae <¢ 


TT 


for all n > nj; i.e., {S,} converges in the mean to f on [—7,7]. 


As a consequence of Theorems 9.2.4 and 9.4.7, we have the following corol- 
lary: 
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COROLLARY 9.4.9 (Parseval’s equality) If f € R[—7, 7], then 


1. C2 me ae: 
p00 + Dan +n) = = _f (x) dx. 


EXAMPLE 9.4.10 By Example 9.3.3(b), the Fourier series of f(x) = = is 
given by 


eS g(—1)""" ; 
w~Y 2d —~ sin naz. 


Here ay = 0 for all n, and b, = 2(—1)"*!/n. Thus by Parseval’s equality, 


which gives 


Proof of Lemma 9.4.8. Let f € R[ia,b] with |f(ax)| < M for all x € [a, }). 
Since f;(x) = f(x) + M is nonnegative, if we can prove the result for the 
function f;, the result also follows for the function f. Thus we can assume 
that f satisfies 0 < f(«) < M for all x € [a, }). 

Let € > 0 be given. Since f is Riemann integrable on [a,b], there exists a 
partition P = {xo0,21,...,2n} of [a,b] such that 


b 
0 < | f(a) dx —L(P, f) < 


where 


and m, = inf{ f(t) :¢ € [w;_-1, ai]}, i = 1,2,...,n. For each i = 1,2,...,n, define 
the functions h; on [a,b] by 


iae Mi, Li-1 [SUL< Xi, 
: 0, elsewhere, 


and let h(w) = >> hy(x) (see Figure 9.5). The function h is called a step 
i=1 

function on [a,b]. Since h is continuous except at a finite number of points, 

h is Riemann integrable and 


n 


b 
i h(x) dz = Yo miAa, = L£(P, f). 


i= 
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FIGURE 9.5 
Graph of the Step Function h 


Therefore, 
7 € 
0< / [f(@) — h(x] de < $. 


Also, since m; = inf{ f(t) : t € [wi-1, v:]}, 0 < h(x) < f(z) for all x € [a, b]. By 
taking slightly shorter intervals, and connecting the endpoints with straight 
line segments, we leave it as an exercise (Exercise 9) to show that there exists 
a continuous function g on [a,b] with g(a) = g(b) = 0, 0 < g(x) < h(x), such 
that 


b 
[ ele) - aa) ae < 5. 


Then 0 < g(a) < f(x), and 


b b b 
0< / [F(«) — g(e)] dx = / [F() — h(x) de + / (h(a) — g(2)] de 
5 


< 


Exercises 9.4 


1. Prove Lemma 9.4.2(a). 


2. *Using the Fourier series of f(z) = 2? and Parseval’s equality, find 
eee 
n=1 nt 

3. *Prove that the orthogonal systems {sinna}72,1 and {1,cosna}721 are 
both complete on [0, z]. 
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4. Show that the set {sin $a, sin 3a, sin 3a, ... } is complete on [0,7] 
Let f € R[—7, 7], and let S;, denote the nth partial sum of the Fourier 
series of f. 


a. Using the Cauchy-Schwarz inequality for integrals (Exercise 13, Section 
9.1), prove that 


[ |Sn(a) — f(a)| dx < V2r ts |Sn(x) — fle)Pae) 


b. Prove that lim f Sr(x)dxr= f f(x)dz . 
TUCO 2 


6. * Use the previous exercise to prove the following: Suppose f € R[—7, 7] 
with 
f(x) ~ $40 + DY (an cosnz + bn sinnz). 


n=1 


For x € [—7,7], set F(x) = i: f(t)dt — $aoa. 


—T 


Then F' is continuous on [—7,7] with F(—7) = F(a), and for all x € 


[-T, mI, 
F(z) = stot 3 a pen (cos na — cos nr) 
2 n=1 v a : 


where the convergence is uniform on [—7, 7]. 


7. By integrating the Fourier series of f(a) = « (Example 9.3.3(b)), find the 


Fourier series of g(x) = x”. 


8. Suppose f is a real-valued periodic function of period 27 with f € 
R|-7, 7], and 2 € R is such that f(a.—) and f(a.+) both exist. Prove 
that 


Jim on(to) = $F (eo) + f(to+) 


9. Complete the proof of Lemma 9.4.8; namely, given the step function h 
on [a,b] and e€ > 0, there exists a continuous function g on [a,b] with 


0< gle) < A(z), g(a) = g(b) =0, and f{h(e) — g(x)] dx <e. 


10. * Let f € Ria, b]. Given € > 0, prove that there exists a polynomial p(x) 
b 
such that f |f(x) — p(x)|dx < e. 


Ee 


9.5 Pointwise Convergence of Fourier Series 


We now turn our attention to the question of pointwise convergence of a 
Fourier series to its defining function. It is known that even if the function is 
continuous, this is not always possible; additional hypothesis on the function 
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f will be required. As was indicated in the introduction, Dirichlet was the 
first to find sufficient conditions on the function f so that the Fourier series 
of f converges to f. For the proof of his result we need several preliminary 
lemmas. 


LEMMA 9.5.1 Let f be a periodic real-valued function on R of period 2a 
with f © R[-a,7]. Fix « © R. Then for any real number A, 


Ae) a=2 f |e Al Da(t) dt, 


where D,, is the Dirichlet kernel and S,, is the nth partial sum of the Fourier 
series of f. 


Proof. By Theorem 9.4.1, 
1 as 
Sp(a) = — f(t()Dn(a — t) dt, 


which by the change of variable s = x — t, 


See i eA O Dass i Pa Du evds: 


+1 Tv —Tw 

Since both f and D,, are periodic of period 27, by Theorem 8.6.3 
1 a+nT 1 wT 
— f(a —s)Dp(s) ds = — f(a — s)D,(s) ds. 
T Je-4n T Jan 


Therefore, 


cae ee LIER Ds s)ds+— =f He-)Dak )Dn(s) ds 


In the first pe set u = —s. Then since D,(—u) = D,(w), 


ele © fle—s)Da(s)ds=—* f° f(a + u)Dn(u) du 
1 Tv 
= =) f(a + s)Dn(s) ds 


S,(x) = + : ‘Ord LI@-9DO es: 


Therefore, 


Finally, since 2 f D,(s)ds = 1, 
0 


which is the desired identity. 
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LEMMA 9.5.2 If g € R[0, x], then 


7 1 
Jim, : g(t) sin (w + 5) tdt =0. 


Proof. Extend g to [—7,7] by defining g(x) = 0 for all x, —7 < x < 0. Since 
sin(n + $)t = cos 4 sin nt + sin £ cosnt, we have 


f sosinins yea [ g(t) sin (n + +) tat 
0 


= / gi(t) sin nt dt +f g2(t) cos nt dt, 
where g;(t) = g(t) cos 5 and g(t) = g(t)sin 5. Since g is Riemann integrable 
on [—7,7], so are both g; and gg. Thus by Theorem 9.3.4, 


wT 


lim gi(t) sin nt dt = lim / g2(t) cos nt dt = 0, 
x noo J_ a 


noo J_ 


from which the result follows. 


Dirichlet’s Theorem 


Before we state and prove Dirichlet’s theorem, we briefly review some notation 
introduced in Chapter 4. For a real-valued function f defined in a neighbor- 
hood of a given point p, the right and left limits of f at p, denoted f(p+) 
and f(p—) respectively, are defined by 


f(p+) = lim, f(x) and f(p—) = lim f(a), 


xw—pt tp 


provided of course that the limits exist. 


THEOREM 9.5.3 (Dirichlet) Let f be a real-valued periodic function on 
R of period 2x with f © R[-1,7]. Suppose x, € R is such that 


(a) f(xot+) and f(a o—) both exist, and 
(b) there exists a constant M and a6 > 0 such that 


Mtoe +t) — fltot)|<Mt and |f(eo-t)—f(eo-)|< Mt (10) 
for allt, 0 <t< 6, then 
Jim Sn(0) = 5lf(@ot) + Feo )] 
Remark. If f is continuous at zo, then $[f(2o+) + f(ao—)] = f(ao), and 


2 
thus 
jim, Sn(Lo) = f (Lo), 
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provided of course that the inequalities (10) hold. 
Proof. Set A = $[f(to+) + f(x.—)]. By Lemma 9.5.1 


Caen ee ={ cee Al Dp(t) dt 


a sin(n + 4)t 
= if (ile. +8 ~ feet) + FG — 8 ~ flee) at 
= =f gi(t) sin(n + $)t dt + =f g2(t) sin(n + 5)t dt, 
where 
a= f(@o +t) — f(tot) “a wi f(a, —t)— f(o-)_ 


2sin § 2sin § 

To prove the result, it suffices to show that the functions g; and gz are Riemann 
integrable on [0,7]. If this is the case, then by Lemma 9.5.2, 

Tv 


lim gi(t) sin(n + $)t dt = 0, r= 1,2. 


noo 
Therefore, 
1 
Jim Sn(@o) =A= glf (tot) + f(®o—)]. 


To finish the proof we still have to show that g; € R[0,7], i = 1,2. We 
will prove the result for the function g;, the proof for gz being similar. Set 
h(t) = f(@o +t) — f(xo+). Since f € R[—7,7] and is periodic of period 27, 
h is Riemann integrable on [0,7]. Also, (sin 5)~' is continuous on (0, 7] and 
thus Riemann integrable on [c, 7] for any c, 0 < c < a. Therefore, 


PO eee 


= 
2sin 5 


is Riemann integrable on [c,z] for any c,0 < c < 7. Let 6 > 0 be as in 
hypothesis (b). Then for 0 < t < 6, using inequality (10), 
= |f(zo + t) — f(®o+)| 
|2 sin 5| 
_ lf(zo + t) — f(Zo+)| 
|¢| 


|g1(t)| 


1 
5t 
~ 1 
sin 5st 


a. 
sin 5t 


Since lim = 1, there exists a constant C’ such that 
z>0+ SIN L 
1 
5b 
2-|<c 
sin 5¢ 


for all t, 0 < ¢ < a. Therefore, g; is bounded on (0,6), and hence also on 
(0, 7]. Thus since g; is Riemann integrable on [c,7] for any c, 0 < c < 7, by 
Exercise 5 of Section 6.2, g1 is Riemann integrable on (0, 7]. 
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Piecewise Continuous Functions 


Dirichlet’s theorem required that f(x,—) and f(a.+) both exist at 2,, and 
that f satisfy the inequalities (10) at the point x,. The existence of both 
f(@o—) and f(a +) means that either f is continuous at x, or in the termi- 
nology of Section 4.4, has a removable or jump discontinuity at 2,. Functions 
that have only simple discontinuities, and at most a finite number on an in- 
terval [a,b], are said to be piecewise continuous on [a, b]. We make this precise 
with the following definition. 


DEFINITION 9.5.4 A real-valued function f is piecewise continuous on 
(a, b| if there exist finitely many points a = x2 < 41 <-+++ < Xn =b such that 
(a) f is continuous on (xj-1,%;) for alli =1,2,...,n, and 
(b) for each i = 0,1,2,...,n, f(ait+) and f(ai—) exist as finite limits. 


For 7 = 0 and n, we of course only require the existence of the right and left 
limit respectively. Also, we do not require that f be defined at 19, 71,...,0n- 
In addition to piecewise continuous functions, it will also be useful to 
consider functions for which the derivative is piecewise continuous. If f is 
piecewise continuous on |a, b], then the derivative f’ is piecewise continuous 
on [a,b] if there exist a finite number of points a = x9 < 41 < ++: <a, =b 
such that 
(a) f’(x) exists and is continuous on each interval (x;-1,7;), 7 = 1,2,...,n, 
and 
(b) for each i = 0,1,2,...,n, the quantities f’(x;+) and f’(x;—) both exist as 
finite limits. Again, for the endpoints a and b we obviously only require the 
existence of f’(a+) and f’(b—). 


Ho 0<a<l, 
ge+2, l<g <2. 
Since f is continuous on (0,1) and (1,2) and f(0+), f(1—), f(1+), and f(2—) 
all exist, f is piecewise continuous on [0,2]. Also, since 


reey= {> O0<a<il, 


EXAMPLES 9.5.5 (a) Consider the function f(x) = 


22, Log <2, 


and f’(0+), f’(1—), f’(14+), and f’(2—) all exist, f’ is also piecewise contin- 
uous on [0, 2]. 


(b) As our second example, consider the function 


r= | : ae 


az sin t, 0<a<l. 
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The function f is both continuous and differentiable on [0, 1] with 


(2) “| : Cae 


cara 1 
2x sin | — cos -, O<a<l. 


However, since f’(0+) does not exist, f’ is not piecewise continuous on [0, 1]. 


Returning to Dirichlet’s theorem, suppose f is such that both f’(a,—) and 
f'(@o+) exist at the point x,. If f’ is piecewise continuous on [—7, 7], then 
there exists x1 > x such that f and f’ are continuous on (25,21). If f is not 
continuous at Xo, redefine f at x as f(x.+). Then f (redefined if necessary) 
is continuous on [%,21), and thus by Theorem 5.2.11 


ian. J (ee + t) = Saxe) 


t>0+ t 


= fet): 


As a consequence, there exists a constant M and a 6 > 0 such that 
If(@o +t) — f(to+)| < Mt 


for all t, 0 < t < 6. Similarly, the existence of f’(a ,—) implies the existence 
of a constant M and a6 > 0 such that 


If(@o — t) — f(to—)| < Mt 


for allt, 0 <t< 6. Thus f satisfies the hypothesis of Dirichlet’s theorem. On 
combining the above discussion with Theorem 9.5.3, we obtain the following 
corollary. 


COROLLARY 9.5.6 Suppose f is a real-valued periodic function on R of 
period 2n. If f and f’ are piecewise continuous on [—1,7), then 
lim Sn(x) = 9[f(x+) + f(x-)] 


n—->co 


for alla eR. 


EXAMPLES 9.5.7 (a) Consider the function f defined on [—7, 7) by 


0, —7<u<—-fF, 
f(x) = 3, FSS 
0, 7 ee ae 


Extend f to all of R as a periodic function of period 27. The function f is 
then continuous except at x = 4m +kr,k € Z. At each discontinuity xo, 


aLf(tot) + f(to—)] = 5. 
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FIGURE 9.6 
Graph of si f(z+) + f(a) 


The graph of $[f(+) + f(z—)] on the interval [—27, 27] is given in Figure 
0.6. 

To discuss convergence of the Fourier series of f, we first note that f is 
piecewise continuous on [—7, 7] and differentiable on (—7,—4), (—5, 5), and 
(5,7) with f’(2) = 0 in the respective intervals. Thus f’ is also piecewise 
continuous on [—7, 7]. As a consequence of Corollary 9.5.6 the Fourier series 


of f converges to $[f(a+) + f(a—)] for all z ER. 


The Fourier series of f is obtained as follows: 


as 


1 6.4 
an = — 3cosnz dx = — sin —, S12 4. 
T Jz nt 2 


n=1 


If n is even, sin * = 0. If n is odd, ie.,n = 2k +1, 
sin(2k + 1)5 =sin (ke + | = cos kr sin 5 = (-1)*. 


Thus 


oo 7 _4)k 
f(a) ~ 5 Oy OF cos(2k + U)o. 
k=0 


When «x = 0, the series converges to f(0) = 3. As a consequence 


3. 6 — (-1)* 
3= 
Dt eT 
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which upon simplification gives 


> (=1)* 
42k+1 4 


(b) Dirichlet’s theorem can also be applied to the Fourier sine and cosine 
series of a real-valued function f defined on [0,7). As an example, consider 
the cosine series of f(x) = x on (0,7). By Exercise 5(b) of Section 9.3, the 
cosine series of f(z) = x is given by 


1 pea if 
~ 2k —1)a. 
ae eae », (Ok 12 cos( )a 


Since the even extension f. of f to [—7,7] is given by f-(x) = |a]|, the cosine 
series of x is the Fourier series of |x| on [—7,7]. Since both f. and f% are 
piecewise continuous on [—7,, 7], the Fourier series converges to the 27-periodic 
extension of |z| for all x € R. 

By Dirichlet’s theorem, the Fourier series converges to |a| for all « € 
[—1, 7]. Taking x = 0 gives 


1 1? 


u Qk—-l?2 8° 


Remarks. Although the inequalities (10) of Theorem 9.5.3 are sufficient, they 
are by no means necessary. There are variations of Dirichlet’s theorem which 
provide sufficient conditions on f to guarantee convergence of the series to 
$[f(zo+) + f(xo—)]. For example, the inequalities of Theorem 9.5.3 can be 
replaced by the following: 


\f(@o +t) — f(aot+)] < Mt® and |f(ao+t)—f(to—-)|}< Mt® = (11) 


for all t, 0 < t < 6, and some a, 0 < a < 1. If f satisfies the above at zo, 
then the conclusion of Dirichlet’s theorem is still valid. An even more general 
condition is due to Ulisse Dini (1845-1918) who proved that if f € R[—7, 7] 
satisfies 


[i fGet Dafa coo maf Wee D= flO) iy <g 
0 t 0 t 


for some 6 > 0, then the Fourier series of f converges to $[f(ao+) + f(xo—)| 
at Xo. Both of the above hold if f satisfies (11) at a. 
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Differentiation of Fourier Series 


Our final result of this section involves the derivative of a Fourier series. Con- 
sider the function f(a) = x. Since both f and f’ are continuous on [—7, 7], the 
Fourier series of f converges to f for all x € (—7,7). Therefore, by Example 
9.3.3(b), 


isang o(—1)°+! ; 
=S>——— € (—1,7). 
x 2 ‘e sin na x € (—7,7) 


The differentiated series 


co 

> 2(—1)"*" cosna 

n=1 
does not converge since its nth term fails to approach zero as n + oo. The 27- 
periodic extension of f has discontinuities at « = +(2k—1)r, k EN. It turns 
out that continuity of the periodic function is important for differentiability 
of the Fourier series. Sufficient conditions are given by the following theorem. 


THEOREM 9.5.8 Let f be a continuous function on [—7, 1] with f(—7) = 
f(a), and let f’ be piecewise continuous on [—1, 7]. If 


1 co 
f(z) = 500 + dalam cosnz+bnsinnx), «x € [-a,7], 

is the Fourier series of f, then at each x € (—1,7) where f’ (x) exists, 

IQS So (=nan sinna + nb, cos nz). (12) 
n=1 

Remark. At a point x where f(a) does not exist but f’(a—) and f”(#+) 

both exist, the series (12) converges to $[f’(x—) + f’(x+)]. 

Proof. Suppose x € (—7,7) is such that f”(x) exists. Since f’ is continuous 

at x, by Dirichlet’s theorem 


1 co 
! = , 
f(“)= 300 + (am cosnz + By, sinnz). 
Since f is continuous with f(—7) = f(7), and f’ € R[-7, 7], 
Le f® i il 7 
cee a ee (t) dt = 5—[f(m) — f(-m)] = 0. 
Also, by integration by parts, 
1 Tv 
On = — f(t) cos nt 
27 J_- 
1 n [7 : 
= am) cosnm — f(—7) cos(—n7)] + es x f(t) sin nt dt 


= nbn. 


452 Introduction to Real Analysis 


Similarly, 8, = —na,y, which proves the result. 


EXAMPLE 9.5.9 Consider the function f(z) = a?. Since f is even on 
(—1, TNs 
f(x) = $a0 + os An, COS NZ. 
n=1 
Also, since f satisfies the hypothesis of Theorem 9.5.8, 


co 


22 = So (=nan sinna). 


n=1 


On the other hand, by Example 9.3.3(b), 


Send A(—1)"+1 


22 = ) ———— sinnz. 
n 


n=1 


Therefore ayn = 4(—1)"/n? for n = 1,2,3,.... To find ao we use the definition. 
This gives ag = 27?/3, and thus 


2 co 
2_7 (=) 


n 


cosnz, «x € [—7,7]. 


Remarks. In closing this section, it should be mentioned that there exist 
continuous functions f for which the Fourier series of f fails to converge at 
a given point. This was first shown by P. du Bois Reymond. Other examples 
were subsequently constructed by L. Fejér and Lebesgue. The example of Fejér 
can be found on p. 416 of the text by E.C. Titchmarsh. Given any countable 
set EF in (—7, 7), it is possible to construct a continuous function f on [—7, 7] 
such that the Fourier series of f diverges on EF and converges on (—7, 7) \ E.4 
In fact, it is possible to construct a continuous function on [—7,7] whose 
Fourier series diverges on an uncountable subset of (—7,7).° The existence 
of functions having such pathological behavior is due to the fact that for the 
Dirichlet kernel D,,, 


Tv 
lim |Dn(#)| dt = oo. 
noo 0 
The details are left to the miscellaneous exercises. 

For all of the above examples it is still the case that the Fourier series of f 
converges to f except on a set of measure zero. This in fact is the case for the 
Fourier series of every Riemann integrable function f on [—7, z]. In 1926, Kol- 
mogorov showed that there exist Lebesgue integrable functions whose Fourier 


4See Chapter VIII of the text by A. Zygmund. 
5Tbid. 
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series diverge everywhere.° The biggest question about the convergence of 
Fourier series was asked by Lusin: If a function f satisfies the hypothesis that 
f? is Lebesgue integrable on [—7, 7], does the Fourier series of f converge to f, 
except perhaps on a set of measure zero? This problem remained unanswered 
for 50 years. The first proof that this was indeed the case was provided by L. 
Carleson in 1966.” 


Exercises 9.5 


1. 


For each of the functions of Exercise 3, Section 9.3, sketch the graph of the 
function on the interval [—27, 27] to which the Fourier series converges. 


*Use the Fourier series of f(x) = x” to find each of the following sums: 


foo) (—1)*1 oO | 
5 ——— b. —- 
“ 2 n? ; yy n? 
Using the Fourier cosine series of f(#) = sinz on [0,7) (Exercise 7, 
Section 9.3), find each of the following sums: 
TA ——— *b. : 
ae 0 ae Lai 


a. Find the Fourier series of f(x) = (7 — |x|)? on [—1, 7]. 


b. On the interval [—27,27] sketch the graph of the function to which 
the series in (a) converges. 


c. Use the results of (a) to find the sums of the following series: 


co pee 
oe ins es 
n=1 n? n=1 n4 


a. Show that for —t < «<7, 


Ts 2 co i n+1 
Pe > 1 ay a (cosnaz — nsinna)|. 


n=1 


b. Use the results of (a) to find the sums of the following series: 


. 2 ey ie 
ey mei Me 2 reg 


*a. Find the Fourier cosine series of e** on [0, 7). 


*b. On the interval [—27, 27], sketch the graph of the function to which 
the series in (a) converges. 


Let f be a continuous function on [—7,z] with f(—7) = f(a). If in 
addition f’ is piecewise continuous on [—7,7], prove that the Fourier 
series of f converges uniformly to f on [—7, 7]. 


6 “Une série de Fourier—Lebesgue divergente partout,” Compte Rendus, 183 (1926), 1327— 


1328. 


7“On convergence and growth of partial sums of Fourier Series,” Acta Math., 116 (1966), 


135-157. 
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8. Suppose f € R[—a, 7], and x € (—7,7) is such that f(x .—) and f(#o+) 
exist, and that 
fin L(t) Sltot)—y f(@o— 8) ~ fla) 
to0o+ t t>0t t 
both exist as finite limits. Prove that f satisfies the hypothesis of Dirich- 
let’s theorem (9.5.3). 

9. Suppose f € R[—7,7] and ao € (—7,7) is such that f(a o—) and f(ao+) 
both exist. If f satisfies the inequalities (11) at x, for some a, 0< a <1, 
prove that the Fourier series of f at x5 converges to $[f(to+) + f(to—)]. 


Notes 


There is no doubt about the significance of Fourier’s contributions to the areas of 
mathematical physics and applied mathematics; one only needs to consult a text on 
partial differential equations. The methods which he developed in connection with 
the theory of heat conduction are applicable to a large class of physical phenom- 
ena, including problems in acoustics, elasticity, optics, and the theory of electrical 
networks, among others. Fourier’s work however is even more significant in that it 
inaugurated a new area of mathematics. 

The study of Fourier series led to the development of the fundamental concepts 
and methods of what is now called real analysis. The study of the concept of a 
function by Dirichlet and others was directly linked to their interest in Fourier series. 
The study of Fourier series by Riemann led to his development of the Riemann 
integral. He was concerned with the question of finding sufficient conditions for the 
existence of the integrals which gave the Fourier coefficients of a function f, that is 
1 


an = — f(x)cosnadz and bp = — f(x) sin nx dx. 
T 


—T =o 


The quest for an understanding of what types of functions possessed Fourier series is 
partly responsible for the development of Lebesgue’s theory of integration. The need 
for a more extensive theory of integration was illustrated by Lebesgue in 1903 in the 
paper “Sur les series trigonometric.”* In this paper, he constructed an example of a 
function that is not Riemann integrable but that is representable everywhere by its 
Fourier series. Such a function is f(x) = —1n|2sin(x/2)| whose Fourier series is 


“cos kx 


This series converges everywhere to the function f on [—7z,7z], but since f is un- 
bounded, it is not Riemann integrable on [—7,7z]. It is however integrable in the 
sense of Lebesgue. The article by Alan Gluchoff provides an excellent exposition 
on the influence of trigonometric series to the theories of integration of Cauchy, 
Riemann, and Lebesgue. 


8 Annales Scientifiques de ’Ecole Normale Supérieure, (3) 20 (1903), 453-485. 
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There are several important topics that we have not touched upon in the course 
of this chapter. One of these is the Gibbs phenomenon, named after Josiah Gibbs 
(1839-1903). To explain this phenomenon, we consider the Fourier series of f(x) = 
0, x € [—7,0), and f(x) = 1, x € [0, 7) of Example 9.3.3(a). By Dirichlet’s theorem 
we have 


‘ 9 & : 0, —7<2<0, 
2k—1)r = 8 = 
a aoe Oi has ea 
Re! i O<a<7T. 


A careful examination of the graphs (see Figure 9.2) of the partial sums S3, Ss, 
and Sis, shows that near 0, each of the functions S;, 7 = 3,5,15, has an absolute 
maximum at a point t;, where the ¢; get closer to 0, but S;(¢;) is bounded away from 
it: 

We now consider the behavior of the partial sums S, more closely. For n = 
(2k-—1),k EN, 


Son—-1(@) = = + 


A |e 


sina + sind fe++4 sin(2k — 1)a] , 


1 
a (2k — 1) 


and 3 
Sop—1(@) = — [cosa + cos 3a +--+ +cos(2k — 1)a]. 
T 
If we multiply $5,,_,(x) by sin and use the identity 
sin x cos jx = 4{sin(j + 1)x — sin(j — 1)a], 


we obtain 


1 
sin x $3,_1(x) = —sinka. 
7 
From this it now follows that S2,_1(#) has relative maxima and minima at the points 
Qha = tr, +27,..., £2(k —1)7. 


These points are equally spaced in (—7,7). Consider the points 1, = 7/(2k), at 
which each S2,—1 has an (absolute) maximum with 


1,2). m7 1... 37, 1 . (Qk-1)0 
Sex—1(te) = 5 + sin + —sin bee + 5 sin Fh : 


To find jim S2k—1(2e), we write the above sum as a Riemann sum of the function 
00 


g(x) = (sinx)/a. This function is Riemann integrable on [0,7]. With the partition 
PR of [0, 1] given by Yi= ueee J = 0, 1,2, 225s and tj = 5 (yj—-1 + Yi)s 


k 
DNs Wi Mess OT 1, (Qk-1)r 1 
fae = tj) Ay; 
n| 2k 3° Ok © pte OR 7 Dat) a 
Therefore, 


2 x 


To approximate the integral we use the Taylor series expansion of sin x. This gives 


lim Son—1(Lx) => ! + | Pe is 
k—- oo 0 


sin x x xt x x 


oT oO Shee aoe EE 
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Therefore, 


2 4 6 
=1 
3-3! 5-5! 7-7! 9-9! 
~ 1 — .54831 + .16235 — .02725 + .00291 


= .59 (to two decimal places). 


The notation “=” denotes approximately equal to. Therefore jim Son—1(@e) © 1.09. 
00 
Even though lim S,(x) = 1 for all x € (0,7), if we approach 0 along the points xz, 
noo 


then S2%-1(xx) overshoots the value 1 by approximately .09, i.e., 
lim | Sox—1(xe) = f(xx)| = 0.09. 
k- oo 


If the Fourier series converges uniformly, this cannot happen. 

The above behavior, known as the Gibbs phenomenon, is due to the fact that f 
has a jump discontinuity at xo = 0, and is typical of the behavior of the Fourier series 
of a piecewise continuous function at a jump discontinuity. Furthermore, if f and f’ 
are piecewise continuous on [—7, 7], then the amount of overshoot at a discontinuity 
xo, due to the Gibbs phenomenon, is approximately equal to 0.09[f(xo+) — f(xo—)]. 
The article by Shelupsky in the supplemental readings provides a very nice discussion 
of this phenomenon. 

Another important question involves the uniqueness of the representation of a 
function by a trigonometric series. Specifically, suppose 
f(x) = S° (Ae coskx + By sinkx) = SG cos kx + D, sin kx) 
k=0 k=0 


for all x € [—7,7], must Ax = Cp and Br = Dx for all k = 0,1,2,...? Alternately, if 


So (Ak cos ka + B; sinkx) =0 (13) 
k=0 


for all x € [—7,7], must Ap = By = 0 for all k = 0,1,2,...? By (13) we mean that 
lim S,,(a) = 0 for all x € [—7,7], where S,, is the nth partial sum of the series. 
n—-oo 


In 1870 Eduard Heine proved that if the sequence {5,} converges uniformly 
to 0 on [—7,7] then Ay = By = 0 for all k. This is Theorem 9.3.6. The general 
uniqueness problem was solved by Cantor in the early 1870’s. He was also able to 
prove uniqueness if (13) holds for all but a finite number of x in [—7, 7]. This then led 
Cantor to consider the uniqueness problem for infinite subsets of [—7, 7]; specifically, 
if E C [—7,7] is infinite and (13) holds for all « € [—7,7]\ E, must Ay = By = 0 
for all k? Since point set theory was undeveloped at this time, this question also led 
Cantor to devote much of his time and effort to studying point subsets of R. For a 
thorough discussion of the uniqueness problem the reader is referred to the article 
by Marshall Ash listed in the supplemental readings or to the text by A. Zygmund 
listed in the Bibliography. 
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Micellaneous Exercises 


1. Suppose f is continuous on [—7,7m) and f(x) = $Ao0 + D> (Ax cos ka + 
k=1 


B,sinkx). Let S;, be the nth partial sum of the series. If there exists a 
positive constant M such that |S;,(x)| < M for all « € [—7,7] andn EN, 
prove that A; and B; are the Fourier coefficients of f. 


2. Prove that lim f |Dn(t)|dt = co, where D, is the Dirichlet kernel. (See 


Example 6.4.4(b).) 


3. Let f(a) = —In|2sin(x/2)|. Show that the Fourier series of f is given 
by >> (coskax)/k. (Note: Since f is unbounded at « = 0, the integrals 
h=1 


defining ax, and by have to be interpreted as improper integrals.) 
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Lebesgue Measure and Integration 


The concept of measure plays a very important role in the theory of real 
analysis. On the real line the idea of measure generalizes the length of an 
interval, in the plane, the area of a rectangle, and so forth. It allows us to talk 
about the measure of a set in the same way that we talk about the length of 
an interval. The development of the Riemann integral of a bounded function 
on a closed and bounded interval [a, 6] depended very much on the fact that 
we partitioned [a, b] into intervals. The notion of measure and measurable set 
will play a prominent role in the development of the Lebesgue integral in that 
we will partition [a,b] not into intervals, but instead into pairwise disjoint 
measurable sets. 

The theory of measure is due to Henri Lebesgue (1875-1941) who in his 
famous 1902 thesis defined measure of subsets of the line and the plane, and 
also the Lebesgue integral of a nonnegative function. Like Riemann, Lebesgue 
was also led to the development of his theory of integration by the problem 
of finding sufficient conditions on a function f for which the integrals defining 
the Fourier coefficients of f exist. In this chapter, we will develop the theory of 
Lebesgue measure of subsets of R following the original approach of Lebesgue 
using inner and outer measure. Although this approach is somewhat more 
tedious than the modern approach due to Constantin Carathéodory (1873- 
1950), it has the advantage of being more intuitive and conceptually easier to 
visualize. 

In the first section we will illustrate the need for the concept of measure 
of a set and measurable function by considering an alternate approach to in- 
tegration developed by Lebesgue in 1928. Although this ultimately will not 
be how we define the Lebesgue integral, the approach is instructive in empha- 
sizing the concepts required for the development of the Lebesgue theory of 
integration. In Section 10.2, we use the fact that every open subset of R can 
be expressed as a finite or countable union of disjoint open intervals to define 
the measure of open sets, and then of compact sets. These are then used to 
define the inner and outer measure of subsets of R. A bounded subset of R is 
then said to be measurable if these two quantities are the same. 

In Section 10.6, we develop the theory of the Lebesgue integral of a 
bounded real-valued function using upper and lower sums as in the devel- 
opment of the Riemann integral. However, rather than using point partitions 
of the interval, we will use measurable partitions. They key result of the sec- 
tion is that a bounded real-valued function on [a,b] is Lebesgue integrable if 
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and only if it is measurable. As we will see, the class of Lebesgue integrable 
functions contains the class of Riemann integrable functions, and for Riemann 
integrable functions, the two integrals coincide. One of the advantages of the 
Lebesgue theory of integration involves the interchange of limits of sequences 
of functions and integration. We will prove several very important and useful 
convergence theorems, including the well known bounded convergence theo- 
rem and Lebesgue’s dominated convergence theorem. 


10.1 Introduction to Measure 


In Definition 6.1.11, we defined what it means for a subset of R to have 
measure zero. In this chapter, we will consider the concept of measure of a 
set in greater detail. When introducing a new concept it is of course very 
natural to ask both “why,” and “does it lead to something useful?” Both 
of these questions were answered by Lebesgue in 1903 when he exhibited 
a trigonometric series that converged everywhere to a nonnegative function 
f that was not Riemann integrable.! The function f however is integrable 
according to Lebesgue’s definition and the trigonometric series is the Fourier 
series of f. 

In this section, we will illustrate why it is necessary to consider the concept 
of measure of a set by considering an alternate approach to integration. As 
we will see later in the chapter, this approach leads to greater generality in 
the types of functions that can be integrated. In addition, Lebesgue’s theory 
of integration also allows us to prove interchange of limit and integration 
theorems without requiring uniform convergence of the sequence of functions. 

Let f be a bounded function on [a,b]. In developing the theory of the 
Riemann integral we partitioned the interval [a,b] and defined the upper and 
lower sums of f corresponding to the partition. An alternate approach to 
integration, due to Lebesgue, is to partition the range of the function, rather 
than the domain. For purposes of illustration suppose f is nonnegative with 
Range f Cc [0, 8). Let n € N, and partition [0, 8) into n disjoint subintervals 


See Figure 10.1 with n = 8. 
For each j = 1, 2,...,n, we let 


By = {oe abs G-08 < se < iS}. 


n 


1“Sur les series trigonometric,” Annales Scientifiques de V’Ecole Normale Supérieure, 
(3) 20 (1903), 453-485. 
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FIGURE 10.1 
Partition of the range of f 


In Figure 10.1, 


EF, = {2 € [a,b] : 38 < f(a) < eh = [a, 1) U [x2, 3) U [a4, x5). 


For a set such as E4, which is a finite union of disjoint intervals, it is reasonable 
to define the measure of F'4, denoted m(£4), as the sum of the length of the 
intervals, i.e., 


m(E4) = (a1 _ a) + (x3 = x2) + (a5 _ XA). 


Assuming that we can do this for each of the sets Ej, a lower approximation 
to the area under the graph of f is given by 


SG - 12 mB, 


j=1 


and an upper approximation would be given by 


Taking limits as n — oo, assuming that they exist and are equal, would in 
fact provide another approach to integration. That this indeed is the case for 
a large class of functions, including the Riemann integrable functions, will be 
proved in Section 10.6. 
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For nice functions, namely those for which the sets E; are finite unions of 


intervals, the above is perfectly reasonable. However, suppose our function f 
is defined on [0, 1] by 


x, elsewhere. 


ro)= |" 2 €Qn(0, 1, 


As above, for each j = 1,2,...,n, let 


nm nm 


By={ee 1:2 < pay <2} 


Thus E, = QN (0, 1] U {a irrational : 0 < x < +}, and for j > 2, 


ae 
Ej; = {2 irrational : G-) <@u< ay 
n n 
Here the sets £; are no longer unions of intervals, and so what is meant by 
the measure of the set is by no means obvious. 

Our goal in the next two sections is to define a function » defined on a 
family M of subsets of R, called the measurable sets, which contains all the 
intervals, and has the property that 

(a) for an interval J, \(J) = length of J, 


(b) \(£ + 2) = A(B), for all EF € M and x € R, where 
E+a={yt+a:yeEk}, and 


(c) \(U Ex) = >> A(E;) for any finite or countable family {F;,} of pairwise 
disjoint sets in M. 


10.2. Measure of Open Sets: Compact Sets 


We begin our discussion of measure theory by first defining the measure of 
open and compact subsets of R. 


DEFINITION 10.2.1 Jf J is an interval, we define the measure of J, 
denoted m(J), to be the length of J. 


Thus if J is (a,b), (a, 0], [a, 6), or [a,b], a,b € R, then 
m(J) =b—a. 


If J is R, (a, 00), [a, 00), (—oo, b) or (—0«, b], we set m(J) = co. In dealing with 
the symbols co and —cx, it is customary to adopt the following conventions: 
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(a) If x is real, then 2 +oo=~, T£-W=-cO. 
(b) If x > 0 then 4-00 =o, x: (—co) = -~w. 


(c) If x <0 then 1-~w =-o, &- (—o0) =~. 
(d) Also, 00 + 00 = 00, —00 — 00 = —00, 00: (+00) = +00, —00- (400) = 
FOO. 


The symbols co — co and —co + co are undefined, but we shall adopt the 
arbitrary convention that 0-0oo = 0. 


Measure of Open Sets 


Our first step will be to extend the set function m to the open subsets of R. 
Since this extension relies on Theorem 2.2.20, we restate that result at this 
point. 


THEOREM 2.2.20 If U is an open subset of R, then there exists a finite or 
countable collection {I,,} of pairwise disjoint open intervals such that 


CS ie 


Recall, the family {J,,} is pairwise disjoint if and only if I, A Im = 0 
whenever n # m. 


DEFINITION 10.2.2 If U is an open subset of R with U = U,, In, where 
{I,} is a finite or countable collection of pairwise disjoint open intervals, we 
define the measure of U, denoted m(U), by 


m(U) = S°mUn). 


n 


Remarks. (a) For the empty set 0, we set m(@) = 0. 


(b) The sum defining m(U) may be either finite or infinite. If any of the 
intervals are of infinite length, then m(U) = oo. On the other hand, if 


seas 
n=1 


where the [,, are pairwise disjoint bounded open intervals, we may still have 
co 
m(U) = $- m(In) = 0, 
n=1 


due to the divergence of the series to oo. Since m(I,) > 0 for all n, the 
sequence of partial sums is monotone increasing and thus will either converge 
to a real number or diverge to oo. 
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EXAMPLES 10.2.3 (a) For each n = 1,2 
1 1 
I, = ’ 
(nae tan) 
(2-4, 2+4), etc. Since n+2- < (n+1)— a 
2, is pairwise disjoint. Let U = UO 


Then = (1-5, 1h a) In = 
for all n € N, the collec died {In}e2 


Then 
co co co 1 
m(0) = Yo mln) = 0256 = Doge = pag =? 
n=1 n=1 n=0 2 
The set U is an example of an unbounded set with finite measure 
, and let V =U? Jn. Then 


(b) Let J, = (n,n +1/n),n =1,2,. 


(c) As in Section 2.5, let U denote the complement of the Cantor set in 
]. Since U is the union of the open intervals that have been removed, by 


[ 


0,1). 
Property 4 of the Cantor set, 


m(U) =1. 


We now state and prove several results concerning the measure of open 


sets. 
THEOREM 10.2.4 IfU and V are open subsets of R with U CV, then 


m(U) < m(V). 


Proof. The statement of the theorem appears to be so obvious that no proof 
seems to be required. However, it is important to keep in mind how the mea- 
sure of an open set is defined. Suppose 
U=|\m said VS) ip; 
n m 


where {J,,}, and {Jm}m are finite or countable collections of pairwise disjoint 
open intervals. Since U C V, each interval [;, C Jm for some m. For each m 


let 
ine AT dy C Tinh 
Since the collection {Jm}m is pairwise disjoint, so is the collection {Nim}m, 


U = Um=U U 


and 
mneENm 
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Therefore 


But by Exercise 1, 


S> mn) < mn); 


nENm 


from which the result follows. 


Remark. As a consequence of the previous theorem, if U is an open subset 
of (a,b), a,b € R, then 
m(U) <b—a. 


Thus every bounded open set has finite measure. 
THEOREM 10.2.5 If U is an open subset of R, then 
mU) = im, m(Ux), 
where for each k EN, Up =U (—k,k). 
Proof. For each k, U;, is open, with 
Ux C Up4i CU 


for all k ¢ N. By Theorem 10.2.4, the sequence {m(U;)} is monotone increas- 
ing with m(U;) < m(U) for all k. Therefore 


Jim m(Uy) < m(U). (1) 
If U is bounded, then there exists k, € N such that 
Un (-k,k) =U 
for all k > ko. Hence m(U;,) = m(U) for all k > ko, and thus equality holds 


in (1). 
Suppose that U is an unbounded open subset of R with 


CS Wis 


where {J,,} is a finite or countable collection of pairwise disjoint open intervals. 
If m(UIn) = co for some n, then m(U) = oo, and for that n, either I, = R or 
I, is an interval of the form 


(—00, Gn) or (Gn, 00) 


for some a, € R. Suppose I, = (an,00). Choose kg € N such that ky > |an|- 
Then for all k > ko, 
I, (—k,k) = (an,k), 


466 Introduction to Real Analysis 


and thus 
oo = lim m(UInN (—k,k)) < lim m(U;,) < m(U). 
k- oo k—o00 


Therefore equality holds in (1). The other two cases follow similarly. 


Suppose m(I;,) < oo for all n. Since U is unbounded, the collection {J,} 
must be infinite. If the collection were finite, then since each interval has 
finite length, each interval is bounded, and as a consequence U must also be 
bounded. Let a € R with a < m(U). Since 


Yo mn) = m(V) > a, 


there exists a positive integer N such that 


N 
a mM(In) > a. 


Let V = (ey I,,. Then V is a bounded open set, and thus by the above, 
mV) = im m(V 1 (—k, k)). 
Since m(V) > a, there exists k, € N such that 
m(V MN (—k,k)) >a for all k > ko. 


But Vn(—k, k) C U;, for all k € N. Hence by Theorem 10.2.4, m(VM(—k, k)) < 
m(U;) and as a consequence 


m(U;,) >a for all k > ko. 


If m(U) = oo, then since a < m(U) was arbitrary, we have m(U;,) > co 
as k > oo. If m(U) < oo, then given € > 0, take a = m(U) — «. By the above, 
there exists k, € N such that 


m(U) —€ < m(Ux) < m(U) for all k > ko. 


Therefore, lim m(U,) = m(U). 
k—- 00 


Remark. In proving results about open sets, the previous theorem allows us 
to first prove the result for the case where U is a bounded open set, and then 
to use the limit process to extend the result to the unbounded case. 


Our next goal is to prove the following: 


THEOREM 10.2.6 If {Un}n is a finite or countable collection of open sub- 


sets of R, then 
m (U 0.) < S> mn). 
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For the proof of the theorem we require the following lemma. 


LEMMA 10.2.7 If {I,,}4_, is a finite collection of bounded open intervals, 
then 
N N 
m (U 1) < S > m(In): 
n=1 n=1 


It should be noted that the collection {J,,} is not assumed to be pairwise 
disjoint. The lemma is most easily proved by resorting to the theory of the 
Riemann integral. 


DEFINITION 10.2.8 Jf FE is a subset of R, the characteristic function 
of E, denoted x,,, 1s the function defined by 


(a) 1, reek, 
4 i 
ea 0, cE€ EL. 


Suppose J is a bounded open interval. Choose a,b € R such that I C [a, }]. 
Since x, is continuous on [a,b] except at the two endpoints of I, x, € R{a, } 
with 


[ue dx = m(I). 


It should be clear that this is independent of the interval [a,b] containing I. 
If U is an open subset of [a,b] with 


v= |) se m<N, 
k=1 


where the {J} are pairwise disjoint open intervals, then 


and thus 
m m b b 
mU) = Soma) = / x,, (a) dx = / Xu (e) de. (2) 


Proof of Lemma 10.2.7 Let {J,,}_, be a finite collection of bounded open 
intervals and let U = eam I,. Choose a,b € R such that U C [a,b]. Then y,, 
is continuous except at a finite number of points, and 


N 
se aCe 
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Therefore by (2) and the above, 


b b N N b N 
m(U) = i xe (a) de < i Sox, (ede = 7 / x1, (0) de = YS (In). 


a 


Proof of Theorem 10.2.6 Since the result for a finite collection follows ob- 
viously from that of a countable collection, we suppose {U,, }°2_, is a countable 
collection of open sets and 
co 
Ces 
n=1 


Since U is open, U = U,,, Jm where {Jm}m is a finite or countable collection 
of pairwise disjoint open intervals. Also, for each n, 


Un = (res 
k 


where for each n, {In,,}% is a finite or countable collection of pairwise disjoint 
open intervals. 

We assume first that U is bounded with m(U) < co. Let € > 0 be given. 
If the collection {Jm}m is infinite, then since )>,,, m(Jm) < 00, there exists a 
positive integer N such that 


Thus 


m=1 
If the collection {Jm}m is finite, the previous step is not necessary. 


Consider the collection {Jm}N_,. For each m = 1,2,...,N, let Km be an 
open interval such that 


yan ay An and = m(Jm) < m(Km) + o 
Then 
N N 
m(U) < S- LOPN ea 4 S- m(Km) + 2¢. (3) 
m=1 


Let A = (eae K,,. Since each K,,, is closed and bounded, so is the set A. 
Thus A is compact, and since 


seu U (Lae). 
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the collection {Zp,,} is an open cover of A. Hence by compactness there exists 
a finite number Inika, > i=1,...,J,7 =1,...,m;, such that 


AC bere 
ing 


Since the intervals {Ky} are pairwise disjoint 


m=1 m=1 


N N 
S> m(Km) =m ( U Kn] <m{LJInia, |. 


which by Lemma 10.4 


Combining this with inequality (3) gives 
m(U) < S- m(U,) + 2e. 
n=1 


Since € > 0 was arbitrary, the result follows for the case where U is bounded. 
If U is unbounded, then for each k € N, 


n=1 


The result now follows by Theorem 10.2.5. 


THEOREM 10.2.9 If U and V are open subsets of R, then 
m(U)+m(V) =m(UUV)+m(UNV). 


Proof. (a) If both U and V are unions of a finite number of bounded open 
intervals, then so are UM V and UUV. Thus the functions 


Xus Xv Xuuv? Xuav 


are all Riemann integrable on some interval [a, b] with 


Xu (#) + Xv (2) = Xvuv (@) t+ Xunv (#) 
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for all x € [a, b]. Therefore by identity (2), 
m(U)+m(V) =m(UUV)+m(UNV). 


(b) For the general case, suppose 


v=Uh and V2 ae 
n=1 


n=1 


where the collections {J,,} and {J,,} consist of pairwise disjoint open intervals 
respectively. If one of m(U) or m(V) is oo, then by Theorem 10.2.4, m(UUV) = 
oo and the conclusion holds. Thus we can assume that both m(U) and m(V) 
are finite. 


Let € > 0 be given. Choose N € N such that 


S- m(In) <¢ and se mMIn) <€. 
n=N+1 n=N+1 


Let U* and U** be defined by 


N oo 
OPS Lies, Si) ale. 
n=1 n=N+1 


Also let V* and V** be defined analogously. Then 
m(U) = m(U*)+m(U™*) and m(V) =m(V*)+m(V**). 

Since m(U**) <e€ and m(V**) <e, 

m(U) + m(V) < m(U*) + m(V*) + 2e. 
Since the sets U* and V* are finite unions of open intervals, by part (a) 

m(U*) + m(V*) = m(U* UV*)+m(U* nN V*), 
which by Theorem 10.2.4 
<m(UUV)+m(UNV). 


The last inequality follows since both U* UV* and U* 1 V* are subsets of 
UUV and UNV respectively. Hence 


m(U)+m(V) <m(U UV) + m(U NV) + 2e. 
Since € > 0 was arbitrary, we have 


m(U)+m(V) <m(UUV)+m(UNV). 
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We now proceed to prove the reverse inequality. We first note that 
UUV=(U*UV*)U(U* UV"), 
and as a consequence 
m(U UV) < m(U* UV*) + 2e. 
Also by the distributive law, 


UNV =(U*UU*)n (V*UV*) 
=(F 0vouw avyuwe ave yun) 
era) uu ur 


Therefore, 
m(UNV) < m(U* NV*) + 2e. 


Combining the above gives 
m(UUV)+m(UNV) < m(U* UV*) + m(U* NV*) 4 4e, 
which since U* and V* are finite unions of intervals 


= m(U*) + m(V*) + 4e 
<m(U) + m(V) + 4e. 


Again since € > 0 was arbitrary, this proves the reverse inequality. 


Measure of Compact Sets 


We now define the measure of a compact subset of R. If K is a compact subset 
of R and U is any bounded open set containing K, then 


U=KU(U\K). 


Using the fact that U \ K is also open and bounded, and thus has finite 
measure, we define the measure of K as follows: 


DEFINITION 10.2.10 Let K be a compact subset of R. The measure of 
K, denoted m(K), is defined to be 


m(K) =m(U) — m(U \ k), 
where U is any bounded open subset of R containing Kk. 


We first show that the definition of m() is independent of the choice of 
U. 
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THEOREM 10.2.11 If K is compact, then m(K) is well defined. 


Proof. Suppose U and V are any two bounded open sets containing kK. Then 


by Theorem 10.2.9 
m(U)+m(V \ K) =m(UU(V \ K))+m(Un(V \ &)) 


m(U UV) +m((U NV) \ K). 


I 


In the above we have used the fact that 
UU(V\K)=UUV and UN(V\K)=(UNV)\K 
Similarly 
m(U \ K)+m(V)=m(UUV)+m((UNV)\ K). 


Therefore 
m(U)+m(V \ kK) =m(V)+m(U \ Kk). 


Since all the terms are finite, 
m(U)—m(U \ K) =m(V) —m(V \ Kk). 


Thus the definition of m(K) is independent of the choice of U; i.e., m(K) is 
well defined. 


EXAMPLES 10.2.12 (a) In our first example we show that for a closed 
and bounded interval [a,b], a,b € R, Definition 10.2.10 is consistent with 
Definition 10.2.1; namely 

m/([a, b]) = b—a. 


Let U = (a—e€,b+e), € > 0. Then 
U \ [a,b] = (a—€,a) U (b,b + €). 
Therefore, 


m((a, b]) = m(U) — m(U \ [a, 8)) 
= (b—a) + 26 — 2e =b—a. 


(b) If K = {a1,...,¢n} with x; € R, then m(K) = 0. Choose 6 > 0 such 
that the intervals 


I; = (aj -—6,2;+6), j=1,2,...,n, 


are pairwise disjoint, and let U = jet I;. Then 


U\K -Ule, — 6,23) U (aj,2; +4)]. 


Thus m(U) = m(U \ K); i.e., m(K) = 0. 
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THEOREM 10.2.13 

(a) If K is compact and U is open with K CU, then m(K) < m(U). 

(b) If Ky and K»2 are compact with K, C Ko, then m(k,) < m(Ko). 
Proof. The proof of (a) is an immediate consequence of the definition. For 


the proof of (b), if U is a bounded open set containing K2, then since U\ Kz C 
U\ Ky, 


m(ky) = m(U) — m(U \ ky) < m(U) — m(U \ Kz) = m(K2) 


If J is an open interval and a,b € R, then IN [a, }] is an interval and thus 
m(I 1M [a, 6]) is defined with 


m(I NM [a, b]) = m(IN (a, b)). 
We extend this to open subsets of R as follows: 


DEFINITION 10.2.14 If U is an open subset of R with U =U, In where 
{In}n ts a finite or countable collection of pairwise disjoint open intervals, 
and a,b eR, we define 


m(U 1 [a, b]) = Sm, NM [a, bj). 


Since m(In AM [a, b]) = m(Ip 2M (a, b)) for all n, we have 


m(U 2 [a, b]) = m(U A (a, b)). 


Remark. What the above definition really defines is the measure of relatively 
open subsets of [a,b] (see Definition 2.2.21). By Theorem 2.2.23, a subset G 
of [a,b] is open in [a,b] if and only if there exists an open subset U of R such 
that G = UN [a,b]. Since the set U may not be unique, we leave it as an 
exercise (Exercise 4) to show that if U, V are open subsets of R with 


UN [a,b] = VN [a,b], 
then m(U / [a, b]) = m(V 2 [a, 8). 
THEOREM 10.2.15 JfU is an open subset of R and a,b € R, then 
m(U Nn [a, b]) + m(U" 2 [a, b]) = b— a. 


Recall from Chapter 1 that US =R\U = {x €R: a €¢ U}. If U is open, 
then U° is closed and thus U° 1M [a, b] is a compact subset of [a, b]. 


Proof. Suppose V > [a,b] is open. Let K = U*N [a,b]. Then since V D K, 


m(K) = m(V)—m(V \ &). 
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But 
V\ kK =VO(USN fa, b))° =(VAU)U(VN [a, b]°) DV NU. 
Therefore, m(V NU) < m(V \ K). Since UN [a,b] CUNY, 
m(U 0 (a, ]) + m(K) < mU NV) +m(V) = m(V \ K) < m(V). 

Given € > 0, take V = (a—€,b+ 6). Then 

m(U 2 |[a, b]) + m(U“ NO [a, b]) < b- a4 2e. 
Since € > 0 is arbitrary, this proves 

m(U 2 [a, b]) + m(U*% A [a, b]) < b= a. 


To prove the reverse inequality, let J. = [a+e, b—], where 0 < € < $(b—a). 
Then 


m(U 1 [a, b]) + m(U% A [a, b]) > m(UN (a, b)) + m(USN I). 
Since (a,b) is an open set containing USN I, 
m(US NI.) =b-—a-—m((a,b) \ (USN I)). 
But 
m((a,b) \ (USN Ie)) = m(((a, b) NU) U ((a, 6) 9 Te) 
= m/(((a,b) NU) U(a,a —€) + (b—.€,))), 
which by Theorem 10.2.6 
< m(U 1 (a, b)) + 2e. 


Therefore 
m(U 1 [a, b]) + m(U*% A [a, b]) > b-— a — 2e. 


Since € > 0 was arbitrary, the reverse inequality follows. 


Exercises 10.2 


1. If {In}n is a finite or countable collection of disjoint open intervals with 
U,, In C (a, b), prove that }> mUn) < m((a, b)). 


2. *If U £@ is an open subset of R, prove that m(U) > 0. 
3. *Let P denote the Cantor set in [0,1]. Prove that m(P) = 0. 
Suppose U, V are open subsets of R, a,b € R with UN [a,b] = VN [a, d]. 
Prove that m(U / [a, b]) = m(V N fa, B]). 
5. If A, B are subsets of R, prove that 
XANB (x) = XA (2)Xx (x), 
Xaup(®) = X4(®) + Xe(®) — Xanw (2), 
Xac (x) =1—x,(2). 
6. *If Ky and Ke are disjoint compact subsets of R, prove that 


m(Ky U Ko) = m(K1) + m( Ko). 
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10.3. Inner and Outer Measure: Measurable Sets 


Our goal in this section is to define a function on a large family M of subsets 
of R, called the measurable sets, which agrees with the function m on the open 
and compact subsets of R. We begin with the definition of inner and outer 
measure of a set. 


DEFINITION 10.3.1 Let E be a subset of R. The outer measure of E, 
denoted \*(E), is defined by 


M*(E) = inf{m(U) : U is open with E CU}. 
The inner measure of FE, denoted X,(E), is defined by 
Ax(E) = sup{m(K) : Kk is compact with K C E}. 
THEOREM 10.3.2 
(a) For any subset E of R, 
0<.(E) < r*(£). 
(b) If FE, and E, are subsets of R with Ey C Es, then 
\x(E1) < Ax (E2) and M*(E1) < »* (£2). 
Proof. (a) If kK is compact and U is open with kK C E CU, then 
0< m(K) <m(U). 


If we fix K, then m(K) < m(U) for all open sets U containing FE. Taking the 
infimum over all such U gives 


0 <m(K) < \*(B). 


Taking the supremum over all compact subsets K of EF proves (a). The proof 
of (b) is similar and is left as an exercise (Exercise 7). 


EXAMPLES 10.3.3 (a) If E is any countable subset of R, then 
Ax(E) = *(E) = 0. 


Suppose FE = {2,,}?°,. Let € > 0 be arbitrary. For each n, let 
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and set U =>, In. Then U is open with E Cc U. By Theorem 10.2.6, 


m(U) < St) = s yo =2¢ 
n=1 n=1 


Therefore, \*(E) < 2e. Since « > 0 was arbitrary, A*(£) = 0. As a conse- 
quence, we also have X,(/) = 0. 


(b) If J is any bounded interval, then 
Ax(1) = A* (I) = m(L). 
Suppose I = (a,b) with a,b € R. Since I itself is open, 
M(L) < m(1) = b= a. 


On the other hand, if 0 < « < (b—a), then [a + €/2,b — €/2] is a compact 
subset of J, and as a consequence 


b-a-e=m/(|a+5,b- =) <A,(I). 


Therefore, 


b—a-—e<X,(L1) < A*(1) < ba. 


Since € > 0 was arbitrary, equality holds. A similar argument proves that if I 
is any closed and bounded interval, then 


de(I) = A*(D) = m(J). 


As a consequence of Theorem 10.3.2(b), the result holds for any bounded 
interval I. 


(c) For any open set U, 


By definition, \*(U) = m(U). But m(U) = > y m(In), where {J,,} is a pair- 
wise disjoint collection of open intervals with U = U,, In. Suppose a € R 
satisfies a < A*(U). Since m(U) > a, there exists a finite number of intervals 


N 
I),...,In such that 57 m(;) > a. For each j, choose a closed and bounded 
j=l 


N 
interval J; C I; such that 5> m(J;) > a. Let K = Uy J;. Then K is a com- 
j=l 


pact subset of U and thus A,.(U) < m(K) Finally, since the intervals {J;}}Ly 
are pairwise disjoint, by Exercise 6 of Section 10.2, 


N 
m(K) = S> m(J;) >a. 


j=1 
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Therefore \,(U) > a. If \*(U) = oc, then by the above A.(U) > a@ for 
every a € R; that is, A.(U) = co. On the other hand, if A*(U) is finite, take 
a = A*(U) —«, where € > 0 is arbitrary. But then A*(U) > \.(U) > A*(U) -€ 
for every € > 0. From this it now follows that A,(U) = A*(U) = m(U). 


Measurable Sets 


In both of the previous examples, the inner and outer measure of the sets 
are equal. As we shall see, all subsets of R build out of open sets or closed 
sets by countable unions, intersections, and complementation will have this 
property, and this includes most sets encountered in practice. In fact, the 
explicit construction of a set whose inner and outer measure are different 
requires use of an axiom from set theory, the Axiom of Choice, which we have 
not discussed. The construction of such a set is outlined in the miscellaneous 
exercises. 


DEFINITION 10.3.4 


(a) A bounded subset E of R is said to be Lebesgue measurable or 
measurable if 
Ax(E) = A*(E). 


If this is the case, then the measure of E, denoted \(E), is defined to be 
A(E) = »4(E) = A*(E). 


(b) An unbounded set E is measurable if EM [a,b] is measurable for 
every closed and bounded interval [a,b]. If this is the case, we define 


AB) = lim (EN [-k, k)). 


Remarks. (a) As a consequence of Example 10.3.3(c) every open set U is 
measurable with 
AU) = m(U) 
(b) If E is unbounded and EN is measurable for every closed and bounded 


interval J, then by Theorem 10.3.2 the sequence {A(E'N [—k, k])}?2, is non- 
decreasing, and as a consequence 


(EB) = lim (EN [-k, k]) 


exists. 


(c) There is no discrepancy between the two parts of the definition. We 
will shortly prove in Theorem 10.4.1 that if EF is a bounded measurable set, 
then EI is measurable for every interval I. Conversely, if EF is a bounded 
set for which 

Ax (EN [a, b]) = A*(E 2 [a, B]) 
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for all a,b € R, then by choosing a and b sufficiently large such that E C [a, }], 
we have 4,.(£) = \*(E). The two separate definitions are required due to the 
existence of unbounded nonmeasurable sets E for which 


An example of such a set will be given in Exercise 5 of Section 10.4. 


THEOREM 10.3.5 Every set E of outer measure zero is measurable with 
A(E) = 0. 


Proof. Suppose E C R with \*(£) = 0. Then for any closed and bounded 
interval J, 

M(EN 1) < A*(£) =0 
Thus A,(£OI) = \*(EN1) = 0, and hence ENT is measurable for every closed 
and bounded interval J. Since A(E'M [—k, k]) = 0 for every k € N, A(E) = 0. 


As a consequence of the previous theorem and Example 10.3.3(a), every 
countable set E is measurable with \(£) = 0. In particular, Q is measurable 
with A(Q) = 0. Another consequence of Theorem 10.3.5 is that every subset 
of a set of measure zero is measurable. 


THEOREM 10.3.6 Every interval I is measurable with \(I) = m(1). 


Proof. By Example 10.3.3(b), if J is a bounded interval, .(1) = A*(Z) = 
m(I). Thus I is measurable with A(J) = m(Z), On the other hand, if I is 
unbounded, then IM [a,b] is a bounded interval for every a,b € R, and thus 
measurable. In this case, 


A(L) = lim A(IIN [-k, k]) = lim m(IN [—k, k]) = o. 
k- oo k-00 
THEOREM 10.3.7 For any a,b€ R and ECR, 
\* (E17 [a, 6]) + Ax(E° 2 [a, b]) = b- a. 


Proof. Let U be any open subset of R with EN [a,b] C U. Then U°N [a, dB] is 
compact with UN [a,b] cC E*N [a,b]. Therefore, 


m(U) + A,(E° 2A [a, b]) > m(U 2 [a, b]) + m(U* N [a, b]) = b- a. 


The last equality follows by Theorem 10.2.15. Taking the infimum over all 
open sets U containing EN [a, b] gives 


\*(EN fa, b]) + x(E°N [a, b]) > b—a. 
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To prove the reverse inequality, let K be a compact subset of EM [a, )]. 
Then K° is open with K°N [a,b] D EN [a,b]. Therefore 


M (EN [a, b]) + mK 2 [a, ]) < m(K°N [a, b]) + m(K Nn [a, b]) = ba. 


The last equality again follows by Theorem 10.2.15 with U = K°. Thus taking 
the supremum over all compact subsets K of EN [a, 6] gives 


M(EN (a, b]) + Ax(E°N [a, b]) < b—a, 


which combined with the above, proves the result. 


LEMMA 10.3.8 For any subset E of R, 


A.(E) = lim (£0 [-k, ki). 


Proof. Since the proof is similar to that of Theorem 10.2.5, we leave it as an 
exercise (Exercise 8). 


THEOREM 10.3.9 Suppose F,, Ez are subsets of R. Then 
(a) A*(E, U Ez) + A*(E, 9 Ea) < A*(E1) + A*(E2), and 
(b) Ax (21 U Ee) + Ay ( E19 Eo) > Ax (1) + Ax (Eo). 


Proof. (a) If A*(£;) = co for some 7, i = 1,2, then inequality (a) certainly 
holds. Thus suppose A*(E;) < oo for i = 1,2. Let € > 0 be given. By the 
definition of outer measure, for each 7, we can choose an open set U; containing 
EF; such that 

m(U;) < A*(Ei) + .: 


Therefore 
e+ \*(E,) + A* (Ee) > m(U1) + m(U2), 
which by Theorem 10.2.9 
= m(U, UU2) +m(U,N U2) 
> * (Ey U Ea) + * (E19 £2). 


The last inequality follows from the definition of outer measure. Since € > 0 
was arbitrary, inequality (a) follows. 


(b) Let a,b € R be arbitrary. By (a) applied to [a,b] N E€, we have 
A" ([a, 6] 9 Ey) + A*([a, 6].9 E53) 
= A ([a, 6]. (EY U E5)) + A*([a, B11 (ET 9 E5)) 
= \*((a, b] N (£1 MN E2)°) + A*([a, 6) N (£1 U E2)°). 
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But by Theorem 10.3.7, for any E CR, 

M* ([a, |] NE) = (b— a) — Ax (EN [a, 6). 
Therefore, 


Ax (E11 [a, b]) + Ax(E2 2 [a, b]) 
< A. (fa, b] N (21.9 E2)) + Ax ([a, 6] N (EB) U E2)). 


For each k € N, set I, = [—k, k]. By the above, 


Ax (FO Ip) + Ax (Bo Ig) < Ax (EL Fe) Ip) + Ax (E11 U Ee) 9 Ip) 
< dx (Fy M E2) + Ax (Ey U Ep). 


The result now follows by Lemma 10.3.8. 


Exercises 10.3 
1. a .IfE CR, a,b€R, prove that \*(EN (a,b)) = A*(EN [a, b]), and 
Ax(EM (a, b)) = Ax(E 2 [a, B]). 


*b. If E CR, prove that A*(# +2) = »*(E) and A. (E+ 2) = X.(£) for 
every « € R, where H+ a= {a+2:a€ E}. 


Prove that every subset of a set of measure zero is measurable. 


*Let E, C R with A*(£,) = 0. If E is a measurable subset of R, prove 
that £, 9 E2 and FE; U £2 are measurable. 


4. Let E = [0,1] \Q. Prove that E is measurable and A(£) = 1. 
Let P denote the Cantor set in [0, 1]. 
a. Prove that A.(P°N [0,1]) =1. 
b. Prove that A*(P) = 0. 


6. *If E C R, prove that there exists a sequence {Un} of open sets with 
E C Uy, for all n € N such that »*(£) = »*((),, Un). 


7. Prove Theorem 10.3.2(b). 
*Prove Lemma 10.3.8. 
a. Prove that every compact set K is measurable with A(K) = m(K). 


b. Prove that every closed set is measurable. 


10.4. Properties of Measurable Sets 


In this section, we will study some of the basic properties of measurable sets. 
Our first result proves that the union and intersection of two measurable sets 
are again measurable. 
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THEOREM 10.4.1 If FE, and E2 are measurable subsets of R, then 
E, OE, and Ey, U Ep, 
are measurable with 
\( Fy) + A( £2) = \(F, U E2) + ACE, Ep). 


Proof. (a) We consider first the case where both FE, and E, are bounded 
measurable sets, in which case, FE, M Eg and FE; U E2 are also bounded. Since 


A(Ei) = Ax (Ei) = "( Ei), i= 1,2, 


(HP By) eR ys) 
(Fy U Ep) a M* (Ey N Ep) < A(E1) + \(E2). 


Therefore, 

Ax (BE, U Eg) + Ax (£1 9 Eg) = \* (Ey U Ex) + \* (E19 Es), 
and as a consequence, 

Ax (Ey U Eo) — * (Fy, U Eo) = * (E19 E2) — Ax (E19 Ee). 


But for any bounded set E, A*(E£) — ».(£) > 0. Thus equality can hold in the 
above if and only if both sides are zero; namely, 


dx (Fy U Ep) = (Ey U E) and rx (Ey NM Ep) = M* (Ey NM Ep). 
Therefore E, 9 Ez and FE; U Ez are measurable, with 
(E41) + \(E2) = NG Di U Ep) + ME M Ep). 


(b) Suppose one or both of the measurable sets E, and £2 are unbounded. 
Let J = [a,b] with a,b € R. If both E; and FE» are unbounded, then E, NJ and 
ETI are measurable by definition. If one of the two sets, say E1, is bounded, 
then by part (a) £, MJ is measurable. Thus in both cases, FE; NI and £21 
are bounded measurable sets. But then 


(EF, EF.) OT and (EU Ee) NI 
are measurable for every closed and bounded interval I with 
M(B, ND) + ACE2 NT) = A(E, 9 Ee) OD) + \((E, U £2) 1). (4) 


Since E, U Ey is unbounded, E, U £2 is measurable by definition. Also, if 
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Fi, M E>, is unbounded, then it is measurable by definition. On the other hand, 
if LE,  E2 is bounded, choose I such that E, 1 E2 C I. In this case, 


(FN Bo) AOL = En Ep. 
Therefore, E; M FE is measurable. Finally, to prove that 


\ME1) + A(B2) = ACE, U Eo) + A(E1 9 Es), 


take Tj, = [—k,k] in (4) and let k > ow. 
Remark. As a consequence of part (a) of the previous theorem, if E is a 
bounded measurable subset of R, then EMI is measurable for every bounded 
interval I. Also, if £,,...,£, are measurable sets, then by induction 


n n 
() Ex and U Ex 
k=1 k=1 
are measurable. 


THEOREM 10.4.2 A subset E of R is measurable if and only if 
M (EM [a, 6]) + A*(E° 2 [a, b]) < b- a 
for everya,bER. 


Proof. Let FE Cc R. Interchanging the roles of EF and E* in Theorem 10.3.7 
gives 
Ax (EN [a, b]) + A*(E° 2 [a, b]) = b-—a 


for any a,b € R. If E is measurable, then EM [a,b] is measurable for every 
a,b ER, and thus 
Ax(E'N [a, b]) = A* (E12 [a, 6]). 


Thus if & is measurable, A*(£ 1M [a, b]) + A*(E°N [a, b]) = b— a. 
Conversely, suppose E satisfies \*(E 1M fa, b]) + A*(E° 2 [a,b]) < b— a for 
every a,b € R. Since we always have 
Ax(E 2 [a, 6]) + A*(E°N [a, b]) = ba, 
we obtain 
M* (EN [a, 6]) — Ax(E'N [a, b]) < 0. 
Since \x(E'N [a, b]) < \*(E'N fa, b]), the above can hold if and only if 


«(E10 [a, b}) = *(E0 [a, b}) 


Thus £1 [a,b] is measurable for every a,b € R. Hence E is measurable. 
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COROLLARY 10.4.3 A set E is measurable if and only if E° is measur- 
able. 


Proof. This is an immediate consequence of the fact that E' satisfies Theorem 
10.4.2 if and only if E° satisfies Theorem 10.4.2. 

Our next goal is to show that the union and intersection of a countable 
collection of measurable sets is again measurable. For the proof of this result 
we require to following theorem. 


THEOREM 10.4.4 
(a) If {En }22, is a sequence of subsets of R, then 


pt (U r,) < $0 A*(En). 
n=1 n=1 
(b) If {E,}82, is a sequence of pairwise disjoint subsets of R, then 


. (U r,) > 57 (Ea) 


n=1 
Proof. (a) If $> A*(£,,) = ov, then the conclusion in (a) is certainly true. 
n=1 


Co 

Thus we assume that >> A*(E;,) < co. Let € > 0 be given. For each n € N, 
n=1 

there exists an open set U, with E, C U, such that 


€ 


m(U,) < »*(En) + ae 


Let U = U7, Un. Then U is an open subset of R with E = U7, Ey c U. 
Thus 


\*(E) <m (U v) ; 


which by Theorem 10.2.6 


< s m(Ua) < s (En) + =) 


I 

Me 
et 
= 
+ 


Since this holds for all € > 0, the result follows. 
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(b) Suppose the sets E,, n = 1,2,... are pairwise disjoint. Since EN E2 = 
), by Theorem 10.3.9(b) 


Ax (B11) + Ax(B2) < Xx (E1 U Eo). 


By induction, 


n 


Ax (Ex) < Ax (U rs) < As (U rs) 


k=1 k=1 k=1 


Since the above holds for all n € N, letting m — oo gives the desired result. 


THEOREM 10.4.5 Let {E,,}°°, be a sequence of measurable sets. Then 
a aer E, and (lee Ey, are measurable with 


(a) \ (U z,| <E 


(b) If in addition the set Ey, n= 1,2,..., are pairwise disjoint, then 
(Ue) =e 
n=1 


Proof. Let E = U>~_, En. Without loss of generality we can assume that E 
(and hence all the sets E,,) is bounded. If not, we consider 


= (Jen tat) 
n=1 


for a,bE R. 
Set A, = Fy, and for each n € N, n > 2, set 


«-ns(Un)-an(iin) 


k=1 


Since finite unions, intersections, and complements of measurable sets are 
again measurable, A, is measurable for each n € N. Furthermore, the sets 
An, n EN, are pairwise disjoint with 


Thus by Theorem 10.4.4(a) and (b), 


57 MAn) < Ae(E) SCE) <2 An 
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Therefore \,(£) = A*(E£), and thus since E is bounded, E is measurable. 
Furthermore, by Theorem 10.4.4 


MB) < So En); 
with equality if the sets E,,, n = 1,2..., are pairwise disjoint. 


By Corollary 10.4.3, E& is measurable for each n. Thus by the above, 
U>2, E& is measurable. Since 


Az-(Um). 


n=1 


the intersection is also measurable. 


THEOREM 10.4.6 
(a) If {En }°2, is a sequence of measurable sets with Ey C Ex C---, then 


x (U r,) = lim X(En). 


n=1 


(b) If {E,}°2, is a sequence of measurable sets with FE, > Ey D--+ and 


A(E1) < 00, then 
BY (n r,) = lim (En). 


n=1 


Proof. (a) Let E = U7, En. By the previous theorem, E is measurable. If 
A( Ex) = co for some k, then \(E;,) = oo for all n > k and \(E) = ov, thus 
proving the result. Hence we assume that (E;,) < oo for all n. 

Set E, = 0, and for n EN, let A, = E, \ En_1. Then each A, is measur- 
able, the collection {A,} is pairwise disjoint, and 


Thus by Theorem 10.4.5(b), 


MB) = 37 MAn) )= jim SMEs \ En-1)- 


But FE, = (Ey \En—-1)U En-1. Since the sets E,, \ En—1 and E,_, are disjoint, 


ME EP eB 
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Therefore 


N 
S> A(En \ En—1) = 
n=1 n=1 
from which the result now follows. 


(b) Let EF = (\~<_, En. Again by the previous theorem EF, is measurable. 
Since 


i, =E U U (By Baas): 


which is a union of pairwise disjoint measurable sets, by Theorem 10.4.5(b) 


[oe) 


ME1) = ME) + 9) MEn \ En+1) 


=1 P 
= (£)+ lim So [A(En) — MEn+41)| 


N-0o 
Ye 


= AB) +(E1) = lim (Ew). 


Since \(E1) < oO, \(E) = Nim \(En +1). 
00 


The Sigma-Algebra of Measurable Sets 


Let M denote the collection of measurable subsets of R. By Theorem 10.3.6, 
every interval I is in M with A(I) = m(J). Since every open set U can be 
expressed as a finite or countable union of pairwise disjoint open intervals, by 
Theorem 10.4.5 every open set U is measurable with 


AM(U) = m(U). 


Since the complement of every measurable set is measurable, M also contains 
all the closed subsets of R. In particular, every compact set K is measurable 
with A(K) = m(K), where m(ix) is as defined in Definition 10.2.10. These 
by no means exhaust the measurable sets. Any set obtained from a countable 
union or intersection of open sets or closed sets, or of sets obtained in this 
manner, is again measurable. 

The collection M is very large. To illustrate just how large we use the fact 
that the Cantor set P has measure zero. Thus any subset of the Cantor set has 
outer measure zero, and as a consequence of Theorem 10.3.5 is measurable. 
By Property 6 of the Cantor set (Section 2.5), P has the same cardinality 
(Definition 1.7.1) as the set of all sequences of 0’s and 1’s. By Miscellaneous 
Exercise 5 of Chapter 1, the set of all sequences of 0’s and 1’s is equivalent 
to [0,1], and this set has the same cardinality as all of R. Thus the set of 
all subsets of P is equivalent (not equal) to the set of all subsets of R. As 
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a consequence, in the terminology of equivalence of sets, M has the same 
cardinality as the set of all subsets of R. However, nonmeasurable subsets of 
R do exist. The construction of such a set will be outlined in the miscellaneous 
exercises. 


We conclude this section by summarizing some of the properties of M. 


THEOREM 10.4.7 
(a) IfE eM, then E° EM. 
(b) 0,REM. 
(c) If E, € M,n=1,2,..., then 


LJ Ene mM and () En eM. 
n=1 n=1 

(d) Every interval Ie M with (I) = m(J). 

(e) ECM, then E+x2 6M for allz €R with 


ME +2) =X(E). 


Proof. The result (a) is Corollary 10.4.3, whereas (b) follows from Theorem 
10.3.6 and Corollary 10.4.3. The statement (c) is Theorem 10.4.5, whereas (d) 
is Theorem 10.3.6. The proof of (e) follows from Exercise 1(b) of the previous 
section. 


Any collection A of subsets of a set X satisfying (a), (b), and (c) of the 
previous theorem is called a sigma-algebra (o-algebra) of sets. The a denotes 
that the collection A is closed under countable unions. 


Remark. An alternate approach to the theory of measure is due to Constantin 
Carathéodory (1873-1950) in which a subset F of R is said to be measurable 
if 

M(ENT) + M(ES OT) = r*(T) (5) 
for every subset T of R. Since T = (ENT)U(E°NT), by Theorem 10.3.9 one 
always has A*(T) < A* (ENT) +A*(E°NT). Thus E satisfies (5) if and only 
if 

M(ENT)+¥(ES NT) < A*(T). 
The advantage to this approach is that it does not require the concept of inner 
measure, and it includes both unbounded and bounded sets simultaneously. 


If a subset E of R satisfies (5), taking T’ = [a,b], a,b € R gives 
M (EM [a, b]) + A*(E° 2 [a, b]) = A*([a, b]) = b- a. 


Thus FE satisfies Theorem 10.4.2 and hence is measurable. In Exercise 6, the 
reader will be asked to prove that if EF is measurable as defined in the text, 
then EF satisfies (5) for every subset T of R. 
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Exercises 10.4 


1. Find a sequence {F,}?°., of measurable sets with E, D Ez D--- such 
that 


A (Ma En) # lim (En). 


2. *If EF is a measurable subset of R, prove that given « > 0, there exists 
an open set U D E and a closed set FC E such that A(U \ E) < € and 
ME\ F) <e. 


3. Let E be a bounded subset of R. Prove that FE is measurable if and only 


if given « > O there exists an open set U and a compact set K with 
KCECU such that \(U \ K) <e. 


4. *If £,, Ez are measurable subsets of [0,1], and if \(£1) = 1, prove that 
ME, M E2) = \(E2). 


5. Suppose £; is a nonmeasurable subset of [0,1]. Set & = E) U (1,00). 
Prove that EF is nonmeasurable but that 


dx (E) = \*(E) = 00. 


6. *(Carathéodory) Prove that a subset E of R is measurable if and only 
if (ENT) + A*(E° OT) = »*(T) for every subset T of R. 


Da 


10.5 Measurable Functions 


In our discussion of Lebesgue’s approach to integration, we defined the sets 


p 


By=feelad 6-9 < se <seh, 


where f : [a,b] — [0,8) is a bounded real-valued function. As we saw in 
Section 10.1, in order to define the integral of f by partitioning the range, it 
is necessary that the sets E;, 7 = 1,...,n, be measurable. Thus we make the 
following definition. 


DEFINITION 10.5.1 Let f be a real-valued function defined on [a,b]. The 
function f is said to be measurable if for every s € R, the set 


{x € [a,b] : f(x) > s} 


is measurable. More generally, if E is a measurable subset of R, a function 
f : £—R is measurable if 


{xe E: f(x) > s} 


is measurable for every s € R. 
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Since f~'((s,co)) = {a : f(x) > s}, f is measurable if and only if 
f—*((s,00)) is a measurable set for every s € R. We illustrate the idea of 
a measurable function with the following examples. 


EXAMPLES 10.5.2 (a) Let A be a measurable subset of R and let y, 
denote the characteristic function of A. Then 


R, 5s <0, 
{z:x,(@)>s}=4A, O<s<1, 
0, s>l. 


Since each of the sets 0, A, and R are measurable, , is a measurable function 
on R. 


(b) Let f : [0,1] + R be defined by 


— 490, x € Qn (0, 1], 
ro)={" x € (0,1]\Q. 


Then 
(0, 1], if s < 0, 
{x € [0,1]: f(z) > ss} = 4§ Q0N(s,1), if0<s<1, 
0, ifs > 1. 


Again, since each of the sets is a measurable subset of R, f is measurable. 


Properties of Measurable Functions 


We now consider some properties of measurable functions. Our first result 
provides several equivalent conditions for measurability. 


THEOREM 10.5.3 Let f be a real-valued function defined on a measurable 
set E. Then f is measurable if and only if any of the following hold: 


(a) {a : f(x) > s} is measurable for every s € R. 
(b) {x : R 
(c) {a : f(x) < s} is measurable for every s € R. 

: R 


(d) {a 


Proof. The set of (d) is the complement of the set in (a). Thus by Corollary 
10.4.3, one is measurable if and only if the other is. Similarly for the sets of 
(b) and (c). Thus it suffices to prove that (a) is equivalent to (b). 

Suppose (a) holds. For each n € N, let 


f(x) > s} is measurable for every s € | 


f(x) < s} is measurable for every s € R. 


By = {2 f(a) > 0-2} 
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By (a), EZ», is measurable for all n € N. But 


{a2 f(z) > 3} = [) Fa, 


which is measurable by Theorem 10.4.5. Conversely, since 


Co 


(esse) > 9} =U {as fea s+}, 


n=1 


if (b) holds, then by Theorem 10.4.5, (a) also holds. 


THEOREM 10.5.4 Suppose f, g are measurable real-valued functions de- 
fined on a measurable set E. Then 


(a) f+c andcf are measurable for every cE R. 

(b) f +g is measurable. 

(c) fg is measurable. 

(d) 1/g is measurable provided g(x) #0 for alla € E. 
Proof. The proof of (a) is straightforward and is omitted. The proof of (a) also 
follows from (b) and (c) upon showing that constant functions are measurable. 

(b) Let s € R. Then f(x) + g(x) > s if and only if f(a) > s — g(a). If 
«x € E is such that f(x) > s — g(x), then there exists r € Q such that 

f(t) >r>s—g(z). 

Let {r,}°2, be an enumeration of Q. Then 


Co 


{a: f(x) + g(a) > s} = U ({e : f(x) > ral He Ee s—g(x)}) , 


n=1 
Since f and g are measurable functions, 
{a: f(x) >rn} and {xz :1n > s—g(x)} 


are measurable sets for every n € N. Thus their intersection and the resulting 
union is also measurable. Therefore f + g is measurable. 
(c) To prove (c) we first show that f? is measurable. If s < 0, then 


{ce E: f?(z)>s}=E, 
which is measurable. Assume s > 0. Then 
{x : f?(x) > s} = {w: f(x) > Vs} fx: f(@) < -Vvs}. 


But each of these two sets are measurable. Thus their union is measurable. 
Since 


I: 
fg=5|0-+or a9) | 
the function fg is measurable. 
(d) The proof of (d) is left as an exercise (Exercise 5). 
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THEOREM 10.5.5 Every continuous real-valued function on [a,b] is mea- 
surable. 


Proof. Exercise 7. 


A Property Holding Almost Everywhere 


A very important concept in the study of measure theory involves the idea of 
a property being true for all x except for a set of measure zero. This idea was 
previously encountered in the statement of Lebesgue’s theorem in Chapter 
6; namely, a bounded real-valued function f on [a,b] is Riemann integrable 
if and only if {a : f is not continuous at +} has measure zero. An equivalent 
formulation is that f is continuous except on a set of measure zero. In this 
section, we will encounter several other properties that are assumed to hold 
except on sets of measure zero. 


DEFINITION 10.5.6 A property P is said to hold almost everywhere 
(abbreviated a.e.) if the set of points where P does not hold has measure zero, 
1.€., 


A({a: P does not hold }) = 0. 


Remark. The assertion that a set is of measure zero includes the assertion 
that it is measurable. This however is not necessary. If instead we only require 
that A*({a: P does not hold }) = 0, then by Theorem 10.3.5 the set 

{x : P does not hold } is in fact measurable. 


We will illustrate the concept of a property holding almost everywhere by 
means of the following examples. 


EXAMPLES 10.5.7 (a) Suppose f and g are real-valued functions defined 
on [a,b]. The functions f and g are said to be equal almost everywhere, 
denoted f = g ae., if 

{x € [a,b]: f(@) 4 g(a)} 


has measure zero. For example, if g(x) = 1 for all x € [0, 1] and 


_ fa x € [0,1]\Q 
r= {f x € (0,1]NQ. 


Then {x € [0,1]: f(a) 4 g(x)} = [0, 1] Q which has measure zero. Therefore 
f=gae. 
(b) In Theorem 10.5.4 we proved that if g is a real-valued measurable 
function on [a,b] with g(a) 4 0 for all x € [a,b], then 1/g is also measurable 
n [a,b]. Suppose we replace the hypothesis g(a) 4 0 for all x € [a,b] with 
g #0 ae.; that is, the set 


E = {x € [a,}] : g(a) = 0} 
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has measure zero. If we now define f by 


_ jglz), zx € [a,b] \ £, 
roy = | 2 € E, 


then f(a) £ 0 for all x € [a,b] and f(x) = g(x) except for x € E, which has 
measure zero. Thus f = g a.e. on [a,b]. As a consequence of our next theorem, 
the function f will also be measurable on [a, 0]. 

(c) A real-valued function f on [a,b] is continuous almost everywhere 
if 

{x € [a,b] : f is not continuous at x} 

has measure zero. As in Example 6.1.14, consider the function f on [0,1] 
defined by 


1, x=0, 
f(x) = 40, if x is irrational 
1, if = ™ in lowest terms ,x # 0. 


As was shown in Example 4.2.2(g), the function f is continuous at every 
irrational number in [0,1], and discontinuous at every rational number in 
(0, 1]. Therefore, 


A({a € [0,1] : f is not continuous at «}) = A(QN [0, 1]) = 0. 


Thus f is continuous a.e. on [0, 1]. 

(d) Let f and f,, n = 1,2,... be a sequence of real-valued functions defined 
on [a,b]. The sequence { f,,} is said to converge almost everywhere to f/f, 
denoted f, > f a.e., if 


{x € [a, ] : {fn(x)} does not converge to f(x)} 


has measure zero. To illustrate this, consider the sequence {f,,} defined in 
Example 8.1.2(c) as follows: Let {x,} be an enumeration of Q/N [0,1]. For 
each n € N, define f,, on [0,1] by 


0, v= zk, 1 < k < n, 
fn(«) = : 
a otherwise. 
Then 
0 if x is rational 
li (2) = ae ; 
3 In(z) = F(z) ‘ if x is irrational. 


Thus {x € [0,1] : {fn(x)} does not converge to 1} = QN [0,1], which has 
measure zero. Hence f;, — 1 a.e. on [0, 1]. 


One of the key results needed in the sequel is the following: 
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THEOREM 10.5.8 Suppose f and g are real-valued functions defined on a 
measurable set A. If f is measurable and g = f a.e., then g is measurable on 


A. 


Proof. Let E = {x € A: g(x) F f(x)}. Then A(E£) = 0. Let B = A\ E. Since 
E is measurable, so is B. Also on B, g(x) = f(x). Fix s € R. Then 


{xe A:g(a)>sh={xe B: g(a )> st {ne z: g(x) > s} 
={reB: f(x) >s}| {xe E: g(a) > s}. 


Since £; = {x € E:: g(x) > s} is a subset of E and A(E) = 0, the set Ey is 
measurable. Also, since f is measurable, {x € B: f(x) > s} is measurable. 
Therefore {x : g(a) > s} is measurable, and thus g is measurable. 


THEOREM 10.5.9 Let {fn}, be a sequence of real-valued measurable 
functions defined on a measurable set A such that {fn(x)}, is bounded for 
every x © A. Let 


p(x) =sup{fn(z):nEN} and w(x) = inf{fr(x):n © N}. 
Then y» and w are measurable on A. 


Proof. The result follows by Theorem 10.4.5, and the fact that for every 
sER, 


{x : p(x) >= Ute: fn(z) > s} and 


{x: v(x) <9) = Ute: fn(x) < s}. 


COROLLARY 10.5.10 Let {f,}°2, be a sequence of real-valued measur- 
able functions defined on a nicasuranle set A, and let f be a real-valued func- 
tion on A. If fn > f ae. on A, then f is measurable on A. 


Proof. Let EF = {x : {fn(x)} does not converge to f(x)}. By hypothesis 
A(E) = 0. Set 
2, Wes ce A\E, 
In() = 0, week. 


Then gn = fn a.e. and thus is measurable. Also, lim gn(a) = g(a) exists for 
n—->co 
all « € A. But 


g(a) = lim ga(x) = Tim gn (x) = inf sup{ f(x) + & > np. 


n—->co 
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By the previous theorem each of the functions 


F,,(«) = sup{ f(a): k& > n} and g(a) = inf { F(x) :n € N} 


are measurable on A. Finally, since f = g a.e., f itself is measurable. 


Suppose {f,,} is a sequence of measurable functions on [a,b] such that 
fn > f ae. Then by definition there exists a subset E of [a,b] such that 
A([a, b] \ &) = 0, and Jim fn(x) = f(a) for all x € E. Exercise 15 provides a 
significant strengthening of this result. There you will be asked to prove that 
given € > 0, there exists a measurable set FC [a, b], such that (a, b]\ E) < e, 
and {f,} converges uniformly to f on E. This result is known as Egorov’s 
theorem. 


Exercises 10.5 


1. *Let f be defined on [0,1] by 


0, x=0, 
1 

f(x) = = O<2<l, 
2, n=l: 


Prove directly that f is measurable. 


2. Let f be a real-valued function on a measurable set A with finite range, 
ie., Range f = {a1,...,a}, a; € R. Prove that f is measurable if and 
only if f~*(a;) is measurable for all 7 = 1,...,n. 

3. Let A be a measurable subset of R, and let f : A — R be measurable. 
Prove that for each n € N, the function f, defined by 


_Jf(x), if |f@)| <n, 
aa nA if |f(a)| > n, 
is measurable on A. 


4. If f is measurable on [a,b], prove that f +c and cf are measurable on 
[a,b] for every cE R. 
5. *If g is measurable on [a,b] with g(x) 4 0 for all x € [a,b], prove that 


1/g is measurable on |[a, 6]. 


6. Let f be a real-valued function on [a,b]. Prove that f is measurable if 
and only if f~'(U) is a measurable subset of [a, b] for every open subset 
U of R. 


7. *Prove that every continuous real-valued function f on [a,b] is measur- 
able. 


8. Let A be a measurable subset of R. If g : A — R is measurable and 
f :R—- R is continuous, prove that f og is measurable. 


9. If f is monotone on [a,b] and g : R — [a,b] is measurable, prove that 
f og is measurable. 
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10. Let & be a measurable subset of R, and let f be a measurable function 
on E. Define the functions ft and f~ on E as follows: 


f*(x) = max{f(x),0}, f~ (x) = max{—f(2), 0}. 
*a. Prove directly that f* and f~ are nonnegative measurable functions 
on E with f(x) = ft (x) — f(a). 
b. Prove that |f(x)| = f* (a) + f7 (x) and that |f| is measurable. 
*c. If f is a real-valued function on [a, 6] such that |f| is measurable on 
[a,b], is f measurable on [a, b]? 
d. If f(x) = 4 +cosa, x € [0,2n], find f*(x) and f7 (a). 
11. Let A be a measurable subset of R and let {fn} be a sequence of mea- 


surable functions on A. Let E = {a € A: { fn (x)}921 converges }. Prove 
that E is measurable. 


12. *Let f be a bounded measurable function on [0, 1] and let { fn} be defined 
on [0,1] by fn(a) = a” f(a). Prove that each f, is measurable and that 
{fn} converges to 0 almost everywhere on (0, 1]. 


13. Let {a,} be an enumeration of the rational numbers in [0,1]. For each 
n € N let 


1 if@=arn,1<k<n, 
fn(z) = 
0 otherwise. 


Show that f, is measurable for each n € N, and that {f,} converges to 
0 almost everywhere on [0, 1]. 


14. *If f is differentiable on [a,b], prove that f’ is measurable on [a, 0]. 


15. *Egorov’s Theorem: Let {f,} be a sequence of measurable functions 
on [a.b] such that f, > f a.e. on [a,b]. Given € > 0, prove that there 
exists a measurable subset E of [a,b] such that A({a, b] \ LE) < € and {fn} 
converges uniformly to f on E. 


16. Construct a sequence {f,} of measurable functions on [0,1] such that 
{fn(x)} converges for each x € [0,1] but that {f,} does not converges 
uniformly on any measurable set E C [0,1] with A((0,1] \ £) =0. 


17. Let f be a measurable function on [a, b]. Prove that the function 
A({x € [a,b] : f(x) > t}), t > 0, 
is nonincreasing and right continuous. 
18. If {fn} is a nondecreasing sequence of measurable functions on [a, b] and 


f = lim fn, then for all t > 0, 
noo 


lim, A(x € [a,8] = |fo(®)] > #}) = AL € a, 6] = [f(@)| > th). 


10.6 Lebesgue Integral of a Bounded Function 


There are many different approaches to the development of the Lebesgue 
integral. One is the method outlined in the first section of this chapter which 
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is pursued further in Exercise 1. The drawback to this approach is that it a 
priori assumes that f is a measurable function. The approach that we will 
follow is patterned on the Darboux approach to the Riemann integral. 


DEFINITION 10.6.1 Let E be a measurable subset of R. A measurable 
partition of E is a finite collection P = {F,...,E,} of pairwise disjoint 
measurable subsets of E’ such that 


Um =2. 


k=1 


Suppose P = {2%o,%1,...,%n} is a point partition of [a,b] as considered 
in Chapter 6. Set Ey = [%,,%1], and for k = 2,...,n, set Ex = (tp_1, Xp]. 
Then the collection P = {F,...,E,} is a measurable partition of [a,b]. A 
measurable partition of [a, b] however need not consist of intervals. For example 
if Ey = [a,b] 1Q and E» = [a,b] \ £1, then {E£,, E2} is a measurable partition 
of [a, J. 

As for the Riemann integral, if f is a bounded real-valued function on 
[a,b], and P = {Fj,...,E,} is a measurable partition of [a,b], we define the 
lower and upper Lebesgue sums of f with respect to P, denoted £z(P, f) 
and U,(P, f) respectively, by 


Lr (P, f) = So meXEx) and Ux(P, f) = $> Med(Ex); 
k=1 k=1 


where m, = inf{f(x) : « € Ex} and M, = sup{f(x) : x € E,}. Clearly 
Li(P,f) < Ur(P,f) for every measurable partition P of [a,b]. As for the 
Riemann integral, we could now define the upper and lower Lebesgue integrals 
of f, and then define a function to be Lebesgue integrable if and only if these 
two quantities are equal. The following theorem however shows that this is 
unnecessary. 


THEOREM 10.6.2 Let f be a bounded real-valued function on [a,b]. Then 


sup Li, f) = inf Uz (Q, Ff); 
P Q 


where the infimum and supremum are taken over all measurable partitions Q 
and P of {a,b], if and only if f is measurable on |a, b}. 


Remark. Although the previous theorem is stated for a closed interval [a, b], 
the result is also true for f defined an any measurable subset A of R with 
(A) < 00. 

As a consequence of the previous theorem, which we will shortly prove, we 
make the following definition. 
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DEFINITION 10.6.3 Jf f is a bounded real-valued measurable function on 
[a,b], the Lebesgue integral of f over [a,b], denoted Sia » f dA (or f f dy), 
is defined by 


f dx — sup£L(P, f), 
[a,b] P 


where the supremum is taken over all measurable partitions of a,b]. If A is a 
measurable subset of [a,b], the Lebesgue integral of f over A, denoted in fda, 
is defined by 


eae} pecan 
A [a,b] 


Remarks. (a) In defining [, fd it was implicitly assumed that f is defined 
on all of [a,b]. If f is only defined on the measurable set A, A C [a, 6], then 
fx, can still be defined on all of [a,b] in the obvious manner; namely, 


f(x), reA, 


(Fx.)(@) = ff ae 


Alternately, if f is a bounded measurable function defined on a measurable 
subset A of [a,b], we could define 


[ fers £112.) 


where the supremum is taken over all measurable partitions Q of A. However, 
if O = {F),...,E,} is any measurable partition of A, then 


P= {Ens wy En, [a, b] \ A} 
is a measurable partition of [a,b] with 


£1(Q, f) = Li (P, fx4). 


Conversely, if P = {F£1,...,£,} is any measurable partition of [a,b], then 
O = {E, NA,..., E, A} is a measurable partition of A for which £,(Q, f) = 
L1(P, fx). Thus the two definitions for [, f d\ give the same value. 

(b) To distinguish between the Lebesgue and Riemann integral of a 
bounded real-valued function f on [a,b], the Riemann integral of f, if it exists, 


will be denoted by 
b 


If in the Lebesgue integral we wish to emphasize the variable x, we will write 


ci f(x) dX(x) to denote the Lebesgue integral of f. The two different notations 
should cause no confusion. In fact, in Corollary 10.6.8 we will prove that every 
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Riemann integrable function on [a, }] is also Lebesgue integrable, and the two 
integrals are equal. 


Prior to proving Theorem 10.6.2, we first need the analogue of Theorem 
6.1.4. 


DEFINITION 10.6.4 Let E be a measurable set and let P be a measurable 
partition of E. A measurable partition Q of E is arefinement of P if every 
set in Q is a subset of some set in P. 


A useful fact about refinements is the following: If P = {Fi,...,E,} and 
OQ = {Aj,...,Am} are measurable partitions of E, then the collection 


{Ei Ag}iet jaa 
is a measurable partition of EF that is a refinement of both P and Q. 


LEMMA 10.6.5 If P, Q are measurable partitions of [a,b] such that Q is a 
refinement of P, then 


L£1(P, f) < L£r(Q,f) <UL(Q, f) <UL(P, f). 


As a consequence, 


sup £1 (P, f) < infUx(Q, f). 
P Q 


Proof. The proof of the lemma is almost verbatim the proof of Lemma 6.1.3 
and Theorem 6.1.4, and thus is left to the exercises (Exercise 2). 


EXAMPLE 10.6.6 In this example, we calculate the Lebesgue integral of 
what is commonly called a simple function on [a,b]. A simple function on 
(a, b] is a measurable real-valued function on [a,b] that assumes only a finite 
number of values. 

Suppose s is a simple function on [a,b] with Ranges = {a1,...,a@n}, where 
a; # a; whenever i # j. For each i = 1,...,n, set 


E; = {x € [a,b] : s(z) = ay} = 871 ({aj}). 


Since s is measurable, each E; is a measurable set, and 
s(t) = >> ax, (2). (6) 
i=1 


Furthermore, since a; # a; if i A j, the sets E;,i = 1,...,n, are pairwise 
disjoint with U}_, Ei = [a,b]. Equation (6) is called the canonical repre- 
sentation of s. If all the sets FE; are intervals, then s is a step function on 
[a, 0]. 
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We will now show that every simple function s is Lebesgue integrable on 
[a,b] and compute the Lebesgue integral of s. 


LEMMA 10.6.7 [fs is a simple function on [a,b] with canonical represen- 
tation 


where {E;}"_, are pairwise disjoint measurable subsets of {a, b| with U;_, Ei = 
[a, b], then s is Lebesgue integrable on [a,b] with 


i sdd = S° ajXE;) 
[a,b] j=l 


Proof. To show that s is Lebesgue integrable on [a, 6] we will prove that 


sup£1(Q, 8) = infU(Q, f), 
fa) Q 


where the supremum and infimum are taken over all measurable partitions Q 
of [a, b]. Since P = { £4, ..., E,} is a measurable partition of [a, b] and s(x) = a; 
for all x € Ej, 


L£L(P, f) =UL(P, f) = Lane 


So ajX(E; \< sup £1 (9, fy< inf Uz (Q, fy< sane 


j=1 j=l 


Therefore s is Lebesgue integrable on [a,b] with f sdA= > aj;A(E;). 
[a,b] ts 


Remark. Suppose f is a bounded real-valued measurable function on |{a, 0]. 
If P = {F4,..., £,} is a measurable partition of [a, b], set 


= So mexXe, (7) and (x) = >> Mexe, (2); (7) 


where m;, = inf{ f(x): a € Ey} and M, = sup{f(x 
w are simple functions on [a,b] with y(x) < f(z) 
Furthermore, by Lemma 10.6.7 


:a © Ey}. Then y and 
(x) for all x € [a, }]. 


IA 


/ yp dX = S > mX(Ex) =L£,(P; f), and 
[a,b] 


k=1 


/ P= ME) = Ulf) 
a, k=1 
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Thus if f is a bounded real-valued measurable function on {a, 6], 
f d\ = sup i yd, 
[a,b] est J [a,b] 


where the supremum is taken over all simple functions y on [a, b] satisfying 
p(x) < f(x) for all x € [a, B]. 

Proof of Theorem 10.6.2. Suppose f is a measurable function on [a, b] with 
m < f(a) < M for all a € [a,b]. Let 8 = M — n, and for n € N, partition 
[m, M) into n subintervals of length 8/n. For each k = 1,...,n, set 


Br = {2 € [at]im+ (k= 1)2 < fla) <m+Keh 


Then P,, = {F£1,...,En} is a measurable partition of [a,b]. Also, if m, = 
inf{ f(x): a € E,} and M; = sup{f(x): x2 € Ex}, then 


Pee ae ie and Meer’. 
n n 


Therefore 


0 < infUz(P, f) - sup£1(Q, f) <UL(Pa, f) — Li (Pn f) 


Since n € N is arbitrary, by letting n — oo we obtain 
sup £1(Q, f) = inf U1 (P, f). (8) 


Conversely, suppose (8) holds. By taking a common refinement if necessary, 
for each n € N, there exists a measurable partition P,, of [a,b] such that 


1 


UL(Pn, f) < infUr(P, f) + —, and 
-p 2n 
1 
Li(Pn, f) > sup £1 (Q, f) — = 
Q n 


Since equality holds in (8), 


Ux(Pn, f) = L1(Pn, f) < 


Sle 
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For the partition P,,, let y, and w,, be simple functions on [a, b] as defined by 
equation (7), satisfying yn(x) < f(a) < wp(a) for all x € [a,b], and 


/ ent = £1 (Pas) Badd <UL Pa f) 
a,b a,b 


Define y and w on [a,b] by v(x) = sup, Yn(x) and W(x) = inf, yp, (x). By 
Theorem 10.5.9 the functions y and w are measurable functions on [a, b], with 


o(a) < f(z) < Y(@) 


for all x € [a, 0]. 


To complete the proof we will show that y = w a.e. on [a,b]. Then as a 
consequence of Theorem 10.5.8, the function f will be measurable on [a, 6]. 
Let 

E= {x € [a,6]: p(x) < o(@)}, 


and for each k €N, let 
1 
Ex, = {2 € [a,b] : p(x) < Y(a) - i}. 


Then E = Up. Ex. If x € Ey, then y,(x) < p(x) — =; for all n € N. For 
n, k EN, let 
1 
An,k = {« > n(x) < Wn(x) — =} : 
If x € Ann, then n(x) — Yn(x) > 1/k. Consider the simple function 


Sn (2) = (Wn(2) — Pn(e))Xa, , (2): 


Suppose the measurable partition P,, is given by {B1,..., By}. Then 


N 
am SoM; i M5)X Bion, (x), 


j=l 
where M; and m,; denote the supremum and infimum of f respectively over 
B;. The collection 

QO = {By Ane}fLa U {[a, 8] \ Anh 


is a measurable partition of [a,b]. If mj = inf{s,(x) : @ € Bj An,x}, then 
m; > 1/k for all j =1,...,N. Also, since s,(x) = 0 for all x € [a,}] \ Ane, 


N N 


k 


‘aie 
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On the other hand, 


N 
Ur(Q,8n) = > _\(My — mj)A(By NM An,x) 


Jj 


Il 
ua 


IA 
Sle 


Il 
ua 


(M; mj)A(B;) =ULz(Pn, f) Lp Past) < 


Combining the above two inequalities gives A(An.,) < k/n for all k,n € N. 
Since E;, C An, for all n, for each k, 


k 
A( Ex) < a 


for all n € N. Therefore A(E;,) = 0. Finally since 


MB) < SEY), 


k=1 


we have \(F) = 0. Thus y = w a.e. on [a,b] which proves the result. 


Comparison with the Riemann Integral 


The definition of the Lebesgue integral is very similar to that of the Riemann 
integral, except that in the Lebesgue theory we use measurable partitions 
rather than point partitions. If P = {xo,71,...,Un} is a partition of [a, b], then 


P* = lao, 21] } U4 opi, Gel} pao 


is a measurable partition of [a,b]. Furthermore, if f is a bounded real-valued 
function on [a, b], then 


LIP, f)=L£1(P*,f) and UP, f) =UL(P*, f). 
Therefore, the lower Riemann integral of f satisfies 
b 
Hh f =sup{L(P, f):P is a partition of [a, b]} 
< sup{£1(Q, f) : Q is a measurable partition of [a, b]}. 
Similarly, for the upper Riemann integral of f we have 


b 
/ f => inf{Uz(Q, f) : QO is a measurable partition of [a, b]}. 


If f is Riemann integrable on [a,b], then the upper and lower Riemann inte- 
grals of f are equal, and thus 


b b 
i: f(a) de < sup £1(Q, f) < infUz(Q, f) < / f(a) de, 
a (9) Q a 
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where the supremum and infimum are taken over all measurable partitions Q 
of [a,b]. As a consequence of Theorem 10.6.2, this proves the following result. 


COROLLARY 10.6.8 If f is Riemann integrable on [a,b], then f is 
Lebesgue integrable on [a,b], and 


ie fdr= [ seo 


The converse however is false! This is illustrated by the following example. 
EXAMPLE 10.6.9 Let E = [0,1] \ Q, and set 


1 


0, when z is rational. 


; when 2 is irrational, 


Hee) =r4l0)= | 


By Example 6.1.6(a) the function f is not Riemann integrable. On the other 
hand, since f is a simple function, f is Lebesgue integrable, and by Lemma 
10.6.7, 


i fd\=X(B)=1. 
(0,1) 


Properties of the Lebesgue Integral for Bounded Func- 
tions 


The following theorem summarizes some basic properties of the Lebesgue in- 
tegral for bounded functions. 


THEOREM 10.6.10 Suppose f, g are bounded real-valued measurable func- 
tions on [a,b]. Then 


(a) for alta, BER, | (af+B9)dr=a f fore f pane 


(b) If Ai, Ag are disjoint measurable subsets of [a,b], then 


[f= f for f tar 


(c) If f > 9 ae. on [a,b], then | 


FOS / ga 
[a,b] [a,b] 


(d) If f = g ae. on [a,b], then far suf gdx. 
[a,b] [a,b] 


dX dX. 
(e) | ie far < de if 
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Proof. Since the proof of (a) is similar to the proof of the corresponding result 
for the Riemann integral we leave it as an exercise (Exercise 4). For the proof 
of (b), by definition 


| far= f FX aqua, - 
A,UA2 [a,b] 


Since Ai Ao = 0, fXajua, = fXa, + Xa,» and the result now follows by 
(a). 
(c) Consider the function h(a) = f(x) — g(x). By hypothesis h > 0 a.e. on 
[a, b]. Let 
E, = {x : h(x) > 0} and E, = [a,b] \ Fi. 


Consider the measurable partition P = {E1, E2} of [a, b]. Then 
‘ KX SLAP A Sra) SABO: 
[a,b] 


Since h(x) > 0 for all x € BE), m, = inf{h(x) : « € E,} > 0. On the other 
hand, since h > 0 a.e., (£2) = 0. Therefore [onan > 0. The result now 
follows by (a). 

The result (d) is an immediate consequence of (c), and (e) is left for the 
exercises. The measurability of | f| follows from Exercise 8 or 10 of the previous 
section. 


Bounded Convergence Theorem 


One of the main advantages of the Lebesgue theory of integration involves the 
interchange of limits. If { f,, } is a sequence of Riemann integrable functions on 
[a, 6] such that f;,(a) converges to a function f(x) for all x € [a,b], then there 
is no guarantee that f is Riemann integrable on [a,b]. An example of such a 
sequence was given in Example 8.1.2(c). For the Lebesgue integral however 
we have the following very useful result. 


THEOREM 10.6.11 (Bounded Convergence Theorem) Suppose { fn} 
is a sequence of real-valued measurable functions on [a, | for which there exists 
a positive constant M such that |f,(x)| <M for alln EN, and all x € [a, 6). 
If 

lim fn(x) = f(x) ae. on [a,b], 


then f is Lebesgue integrable on [a,b] and 


fd\= lim fn dD. 
noo b] 


[a,b] [a 


Remark. Although we state and prove the bounded convergence theorem for 
a closed and bounded interval {a, b], the conclusion is still valid if the sequence 
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{fn} is defined on a bounded measurable set A. The necessary modifications 
to the proof are left to the exercises. 


Proof. Since f, — f a.e., f is measurable by Corollary 10.5.10, and thus 
Lebesgue integrable. Let 


E = {x € [a,b]: f(x) does not converge to f(x)}. 
Define the functions g and g,,, n € N, on [a, }] as follows: 
fn(z), «x € [a,b] \ £, f(x), «ve€la,b]\ FE, 
alaye fir TEE, oy [7@, 2ela,8)\ 
0, rel, 0, re. 
Since A(E) = 0, gn = fn ae. and g = f a.e. Therefore 


b b b b 
[mars fnd\ and fon= fdr. 


Furthermore, g,(”) > g(x) for all x € [a,b]. Let « > 0 be given. For m € N, 
set 

Em, = {x € [a,b] : |g(@) — gn(x)| < € for all n > m}. 
Then £, C £2 C--- with U7, En = [a,b]. Therefore 


() Hi =9. 


m=1 


Here EC, = [a,b] \ Em. Thus by Theorem 10.4.6 lim A(ES,) = 0. Choose 
m—->co 
m €N such that A(ES,) < «. Then |g(%) — gn(x)| < € for all n > m and all 


a € E,,. Therefore 
b b 
i gdr— f Jndr < | lg — 9n| dA 
a a [a,b] 


b b 
jf ra- fi fran 
=| g—ooldr+ f ipod 
E Es, 


™m 


< €A(En) + 2M (EF) < €[b-a+ 2M]. 


Since € > 0 was arbitrary, we have lim Sia p) dndAd = Sia ») fad. 


Combining the bounded convergence theorem with Corollary 10.6.8, we 
obtain the bounded convergence theorem for Riemann integrable functions 
previously stated in Chapter 8. The theorem does require the additional hy- 
pothesis that the limit function f is Riemann integrable. 


THEOREM 8.4.3 Let f and f,,, n € N, be Riemann integrable functions on 

[a,b] with lim f,(a) = f(x) for all 2 € [a,b]. Suppose there exists a positive 
noo 

constant M such that |f,(a)| << © for all x € [a,b] and all n € N. Then 


b b 
Jim, Fn{&) ax | f(x) dx. 
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EXAMPLES 10.6.12 (a) In the first example we show that the conclu- 
sion of the bounded convergence theorem is false if the sequence {f,} is 
not bounded; that is, there does not exist a finite constant M such that 
|fn(a)| < M for all n € N, and all x € [a,b]. For each n € N, define f, 


on [0,1] by 
n, 0<a< 1, 
Ina) = i otherwise. 


Then {fp}? is a sequence of measurable functions on [0,1] that is not 
bounded but which satisfies 


lim fn(x) = f(x) =0 for all x € [0,1]. 


N—- Co 


However, ic fn dX = nX((0, 1/n]) = 1. Thus 


lim A DSIL0E-}- Fax. 


tO? S10") [0,1] 


(b) As our second example we consider the sequence {f;,} of Example 
9.2.3. For each n € N, write n = 2" + j, where k = 0,1,2..., and 0 < j < 2*. 
Define f,, on [0, 1] by 


0, otherwise. 


The first few of these are as follows: fi) = X04, f2 = Xioay? fs = x 
5 4 
fs = Xioayr For each n EN, fr € R[O, 1] with 
a 


1 o] 
Ay 


: 1 
i fn(x) da = 5K 


Thus lim fo fn(x) dz = 0. On the other hand, if x € [0, 1], then the sequence 
n—->OCo 


{ fn(z)} contains an infinite number of 0’s and 1’s, and thus does not converge. 


Exercises 10.6. 


1. *Let f be a bounded real-valued measurable function on [a, b] with m < 
f(x) < M for all x € [a,b]. Set 6 = M —™m. For n € N and j = 1,...,n, 
let FE; = {x € [a,b]: m+ (j - 1)8 <f(a)< m+ 8h. 


The Lebesgue sums for f are defined by 


n 


Sn(f) = (m+ Gi — 1)8)A(B;). Prove that 


j=l 


lim Sn(f) = fdr. 


n—-oco [a,b] 
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2. Prove Lemma 10.6.5. 

3. *Let f be a bounded measurable function on [a,b]. If A is a measurable 
subset of [a,b] with \(A) = 0, prove that f, f dA = 0. 

4. a. Prove Theorem 10.6.10(a). 
b. Prove Theorem 10.6.10(e). 


5. *Let f be a nonnegative bounded measurable function on [a,b]. If E, F 
are measurable subsets of [a,b] with E C F, prove that ff ddA < f fda. 
E F 


6. Let f be a bounded measurable function on [a,b]. For each c > 0, prove 
that 
1 
New lad @l> a <5 fifa 
a,b 
7. *Let f be a nonnegative bounded measurable function on [a, b] satisfying 
Sia 5] f d\ = 0. Use the previous exercise to prove that f = 0 a.e. on [a, b]. 


8. (Fundamental Theorem of Calculus for the Lebesgue Integral) If 
f is differentiable on [a, b] and f’ is bounded on [a,b], then f’ is Lebesgue 
integrable, and 


f' d= f()— f(a). 


[a,b] 
oo 7/2 
9. Prove that 5> f (1 —.4/cosaz)” sinx dx converges to a finite limit, and 
n=0 0 


find that limit. 


10. Let f be a bounded measurable function on [a,b] such that |f| < 1 a.e. 
on [a,b]. Prove that lim f f"dA=0. 
MFO TE b] 
11. Let {fn} be a sequence of nonnegative measurable functions on [a,b] 
satisfying fn(x) < M for all x € [a,b] and n EN. If {f,} converges to f 
a.e. on [a,b], prove that 


lim fre d= fet dy. 
NCO Ja, [a,b] 


12. *If f is a bounded real-valued measurable function on [a,b], prove that 
there exists a sequence {s,} of simple functions on [a,b] such that 
lim sn(x) = f(x) uniformly on |[a, )]. 
noo 

13. Modify the proof of the bounded convergence theorem where the interval 
[a, b] is replaced by a bounded measurable set A. 


14. Use Egorov’s theorem (Exercise 15, Section 10.5) to provide an alternate 
proof of the bounded convergence theorem. 


15. Let f be a bounded measurable function on [a, b]. 


a. Given € > 0, prove that there exists a simple function ¢ on |[a, b] such 


that f |f—yldaA<e. 
[a,b] 


*b. If y is a simple function on [a, b] and € > 0, prove that there exists a 
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step function h on [a, b] such that y(x) = h(x) except on a set of measure 
less than e. 


c. Given € > 0, prove that there exists a step function h on [a,b] such 


that f |f—h|d\<e. 
[a,b] 


16. Let S,(x) = $Ao + 2 Ancoske + By sinker, If |S,(x)| < M for all 


x € [-7,7] and n € 'N and f(z) = lim S),(z) exists a.e. on [—7, 7], 
n—>oo 


prove that f is measurable and that the A, and By, are the Fourier 
coefficients of f. 


10.7 The General Lebesgue Integral 


In this section, we extend the definition of the Lebesgue integral to include 
both the case where the function f is unbounded, and also where the domain of 
integration is unbounded. We will then prove the well known results of Fatou 
and Lebesgue on the interchange of limits and integration. We first consider 
the extension of the Lebesgue integral to nonnegative measurable functions. 


The Lebesgue Integral of a Nonnegative Measurable Function 


Suppose first that A is a bounded measurable subset of R, and that f is a 
nonnegative measurable function defined on A. For each n € N, consider the 
function f,, defined on A by 


f(x), if f(a) <n 


fn(«) = min{ f(x),n} = i if f(x) — 


Then {f,,} is a sequence of nonnegative bounded measurable functions defined 
on A, with lim f,(x) = f(x) for all x € A. Furthermore, if m > n, then 
n—->co 


for all x € A, and thus the sequence 


(heey 


is monotone increasing, and therefore converges either to a real number, or 
diverges to oo. This leads us to make the following definition: 
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DEFINITION 10.7.1 


(a) Let f be a nonnegative measurable function defined on a bounded mea- 
surable subset A of R. The Lebesgue integral of f over A, denoted fo fa, 
is defined by 


[fa tim, | fydr=sup | min{ f,n} dy. 


(b) If A is an unbounded measurable subset of R and f is a nonnega- 
tive measurable function on A, the Lebesgue integral of f over A, denoted 
J, fda, is defined by 


| fdX\= lim fd. 
A 


NX J AN[—n,n] 


In part (b) of the definition, the sequence 


aces) 
An[—n,n] neN 


is also monotone increasing, and thus converges either to a nonnegative real 
number, or diverges to oo. In the definition we do not exclude the possible 
value of oo for the integral of f. If the integral however is finite, we make the 
following definition. 


DEFINITION 10.7.2 A nonnegative measurable function f defined on a 
measurable subset A of R is said to be Lebesgue integrable on A if 


[ tao 


Remark. If A is either a finite or infinite interval with endpoints a, b € 
RU {—o0, co}, then the integral of a nonnegative measurable function f on A 


b 
is also denoted by f[ f dA. 


EXAMPLES 10.7.3 (a) For our first example we consider the function 
f(x) = 1//@ defined on (0,1). Then for each n €N, 


1 
n, OS OS Fa! 


f(a) =min{f(z),n}= 4 1 
ve" 


DS eeu 
ne 


Therefore 


1 1/n? 1 1 1 9 1 
ee ae ae 
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As a consequence 
fd\= lim fr dd = lim (2— +) =2. 


The answer in this example corresponds to the improper Riemann integral 
of the function f. This will always be the case for nonnegative functions for 
which the improper Riemann integral exists (Exercise 18). 


(b) Let g(x) = 1/2, 0 < « < 1. For the function g, 


: n, 0O<a< 1, 
min{g(z),n} = fi ne, 
Therefore 
1 1/n 14 
ih min{g,n} da = [ ndr+ | —dz=1+41nn. 
0 0 1/n & 
Thus 


1 
i gd = lim (14+ Inn) =o. 
0 n—->co 


Since the Lebesgue integral of g is infinite, g is not integrable on (0, 1]. 


(c) As our final example, consider f(a) = «~? defined on A = (1,00). In 
this example, for n > 2, AN [—n,n] = (1, n], and 


n n 1 
| far= f g "de =1——. 
1 1 n 


2 1 
/ fdd= lim 1-— =1. 
1 noo nN 


Thus f is integrable on (1,00). 


Therefore 


The following theorem summarizes some of the basic properties of the 
Lebesgue integral of nonnegative measurable functions. Integrability of the 
functions f and g are not required. 


THEOREM 10.7.4 Let f, g be nonnegative measurable functions defined on 
a measurable set A. Then 


[utaa= | tars f oa and [ctarmef far for at 


(b) If Ai, Az are disjoint measurable subsets of A, then 


{ far= f far+] far. 
A,UA2 Aj Ag 


(c) If f<g ae. onA, then | faAs< / gdx, with equality if f=g ae. 
A A 
on A 


c> 


Lebesgue Measure and Integration 511 


Proof. We will indicate the method of proof by proving part of (a). The 
remaining proofs are left to the exercises (Exercise 2). Suppose first that the 
set A is bounded. Let h = f + g. Since 


min{ f(x) + g(z),n} < min{ f(x), n} + min{g(z),n} < min{ f(x) + g(x), 2n}, 


we have hy < fn + gn < hon for all n € N. As a consequence 


[mars | fad f gndr< [ hon dd. 
A A A A 


Suppose f, g are integrable on A. Then 


lim (| futd+ f and) = lim | fndd+ lim [nar f fare f gad. 


Therefore, since 


lim | hyd = lim | hand = | (f + 9)ad, 
noo J 4 noo J 4 A 


the result follows from the above by letting n — oo. If one, or both of the 
sequences {f, fnd\}, {4 Gn dA} diverges to oo, then so does their sum. In 
this case, we obtain Ge +g)dX = oo. If A is unbounded, then by the above, 
for each n EN, 


/ (ft+g)di= fart | gd, 
AnN[-n,n] An[=n,n] An[=n,n] 


and the result again follows by letting n > co. 


As a consequence of the previous theorem if f and g are nonnegative 
integrable functions on the measurable set A, then so is f +g and cf for every 
c > 0. Furthermore, if f < g a.e. and g is integrable, then so is f. 


Fatou’s Lemma 


Our first major convergence theorem for integrals of nonnegative measurable 
functions is the following result of Fatou. 


THEOREM 10.7.5 (Fatou’s Lemma) /f {f,,} is a sequence of nonnega- 
tive measurable functions on a measurable set A, and lim f,(x) = f(x) ae. 
noo 


on A, then 


n—- Co 


[tarsi | tra. 
A A 
Proof. Suppose first that the set A is bounded. For each k € N, let 


hy,(x) = min{ f, (x), k} and h(a) = min{ f(a), k}. 
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Then for each k € N, the sequence {h,} converges a.e. to h on A. Since 
|hn(x)| < k& for all x € A, by the bounded convergence theorem 


if min{ f,k}d\ = lim | min{ f,,k}d\ < lim find. 
A n->co JA n->co JA 
Since the above holds for each k € N, 
/ fd\= lim [ min(t. ia < lim fin dX. 
If A is unbounded, then by the above, for each k € N 


fo favs tim fndd< lim ff, ad. 
An[—k,k] 


n—-Co An[—k,k] nowoJdwA 


Letting k — oo will give the desired result. 


EXAMPLE 10.7.6 In this example, we show that equality need not hold in 
Fatou’s lemma. Consider the sequence {f,,} on [0,1] of Example 10.6.12(a). 
For each n € N, fn(z) = n if 0 < a < 4, and f,(x) = 0 elsewhere. This 
sequence satisfies 


o= | (lim f,)d\<1= lim fr aX. 


0,1] Roe noo J [0.1] 


Remark. Fatou’s lemma is often used to prove that the limit function f of a 
convergent sequence of nonnegative Lebesgue integrable functions is Lebesgue 
integrable. For if lim [, fndA < oo and if f, + f a.e. on A with f, > 0 ae. 
for all n, then by Fatou’s lemma if fd < o. Thus f is integrable on A. 


The General Lebesgue Integral 


We now turn our attention to the case where f is an arbitrary real-valued 
measurable function defined on a measurable subset A of R. As in Exercise 
10 of Section 10.5, we define the functions f* and f~ on A as follows: 


ft (x) =max{f(x),0}, f(r) = max{—f(z), 0}. 


If f(x) > 0, then f*(x) = f(x) and f~ (x) = 0. On the other hand, if f(x) < 0, 
then ft(x) = 0 and f~(x) = —f(a). If f is measurable on A, then ft and 
f~ are nonnegative measurable functions on A with 


f(x) = f*(x)— f(x) and |f(x)| = f*(z) + f (2) 


for all x € A. 
Our natural inclination is to define the integral of f over A by 


[ta=fra-f[ ra 
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The only problem with this definition is that it is possible that [, ftdA = 
nf aJ_ dA = & giving the undefined oo—oo in the above. However, if we assume 
that both f* and f~ are integrable on A, then the above definition makes 
sense. Furthermore, if f is measurable, and ft and f~ are both integrable on 
A, then |f| is also integrable on A. Conversely, if f is measurable and |f| is 
integrable on A, then since f* < |f| and f~ < |f|, by Theorem 10.7.4(c) both 
f* and f~ are integrable on A. Therefore we make the following definition. 


DEFINITION 10.7.7 Let f be a measurable real-valued function defined 
on a measurable subset A of R. The function f is said to be Lebesgue inte- 
grable on A if |f| is Lebesgue integrable on A. The set of Lebesque integrable 
functions on A is denoted by L(A). For f € L(A), the Lebesgue integral of 
f on A is defined by 


[ta=[ra-fra 


Remark. The set £(A) of Lebesgue integrable functions on A is often also 
denoted by £1(A). 

The definition of the general Lebesgue integral is consistent with our defini- 
tion of the Lebesgue integral of a bounded function on [a, ]. If f is a bounded 
real-valued measurable function on [a,b] then so are the functions ft and 
f-. Let Ey = {x : f(x) > 0} and Ey = {x : f(a) < 0}. Then EF, and £2 
are disjoint measurable subsets of [a,b] with E, U E2 = [a, 6]. Furthermore 
fX2, = f* everywhere and fy,, = —f~ a.e.. By Theorem 10.6.10(b) 


[ fdv\= fdA+ ie 
Ey 


af oes fXn, dA = [ra- ice dn. 


Remark. For a nonnegative measurable function, the Lebesgue integral and 
the improper Riemann integral are the same, provided of course that the 
latter exists (Exercise 18). This however is false for functions that are not 
nonnegative. For example, consider the function f(x) = (sinz)/a, x € [7,00), 
of Example 6.4.4(b). By Exercise 7 of Section 6.4, the improper integral of f 
exists on [77, 00). However, as was shown in Example 6.4.4, 


oo (n+1)m |G: 
/ |fld\ = tim, [ ee 
a n>00 Ja x 


Thus f is not Lebesgue integrable on [7,0o). Another such example for a 
finite interval is given in Exercise 23. The crucial fact to remember is that a 
measurable function f is Lebesgue integrable on a measurable set A if and 
only if f', |f| dA < oo. 

Our first result is the following extension of Theorem 10.7.4 to the class of 
integrable functions. 
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THEOREM 10.7.8 Suppose f and g are Lebesgue integrable functions on 
the measurable set A. Then 


(a) ft+g andcf,c ER, are integrable on A with 


[roars f sars f gar and [etanef sa. 


(b) If f <g ae. on A, then | fa< | gdx, with equality if f = a.e. 
A A 
(c) If Ay and Ag are disjoint measurable subsets of A, then 


/ far= f far+] far. 
A,UA2 Aj Ag 


Proof. The proof that cf is integrable and that Av cf d\ = ely f dX follows 
immediately from the definition. Before proving the result about the sum, we 
first note that the definition of the integral of f on A is independent of the 
decomposition f = f* — f~. Suppose that f = f1 — fo where f; and f2 are 
nonnegative integrable functions on A. Then 

fi+th=f +h, 
and thus by Theorem 10.7.4, 


[ras+fna-f ras f pa 


Since all the integrals are finite, 


[ta=fra-f raf na-f ro 


If f and g are integrable on A, then by definition so are the functions 
ft +g? and f— +g~. Since f +g =(ft +gt)—(f~ + 97), by the above 


[tous forte fir toa 


which by Theorem 10.7.4 


=f star fi pat f otar— f ow 
= [tars [ gar 


(b) If f <g ae., then g— f >0a.e. Therefore by part (a), 


o< f@-nar= faa f far 


from which the result follows. (c) The proof of (c) also follows from (a) and 
the fact that since Ay Ao =9, fxaica, = fX4, + fXa,- 
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Lebesgue’s Dominated Convergence Theorem 


Our second major convergence result is the following theorem of Lebesgue. 


THEOREM 10.7.9 (Lebesgue’s Dominated Convergence Theorem) 

Let {fn} be a sequence of measurable functions defined on a measurable set A 

such that lim f,(x) = f(x) exists a.e. on A. Suppose there exists a nonneg- 
n—-Co 


ative integrable function g on A such that |fn(x)| < g(x) ae. on A. Then f 


is integrable on A and 
| fd\= lim | fin a. 
A noo A 


Proof. Since g is integrable on A, and |f,,| < g a.e. on A, by Theorem 10.7.4 
each f,, is also integrable on A. Also, by Corollary 10.5.10, the function f is 
measurable on A. Furthermore, by Fatou’s lemma, 


fitlarsim f itars gar < oo. 
A A A 


Thus f is also integrable on A. 

By redefining all the f,,n € N, on a set of measure zero if necessary, 
we can without loss of generality assume that |fn(x)| < g(a) for all « € A. 
Consider the sequence {g + fn}nen of nonnegative measurable functions on 
A. By Fatou’s lemma, 


forna- | Mt eane tim | ee ex 
A Ano n= 


oJA 
=f gar+ lim fndd. 
nwJdA 


Therefore, 


i fav < lim Ps 

noo 
Similarly, by applying Fatou’s lemma to fs sequence {g — fn}nen, which is 
again a sequence of nonnegative functions on A, 


[e- fad < lim [(a- fa)ar= f gar+ lim | (—fa)ad 


n—-oco nrwoJdA 
But lim [,(—fn)dA = — lim J, fndd. Therefore, 
n—oo noo 
fax> im i FO. 
[raz inf, 


Combining the two inequalities gives the desired result. 


Remark. The hypothesis that there exists an integrable function g satisfying 
|fn| < g ae. is required in the proof in order to subtract { gdA in the above 
inequalities. This is not possible if [gd = oo. As the following example 
shows, if such a function g does not exist, then the conclusion may be false. 
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EXAMPLE 10.7.10 As in Example 10.6.12(a) consider the sequence { f,, } 
on [0,1] defined by 


n, 0<a< 1, 
0, elsewhere. 


For the sequence { f,,} we have Jim, fn(x) = 0 for all x € [0,1] but So, fndd = 
1 for all n. We now show that any measurable function g satisfying g(x) > 
f(x) for all x € [0,1] and n € N satisfies fi, ,) 9 dA = 00. Since g(x) > fn(x) 
for all « € [0,1] we have g(x) > n for all x € (=, 7 
{Ga z]}R_, of intervals is pairwise disjoint, by Theorem 10.7.4 


dv > Fe Ge 0 ee . 
ls oy ae 2, (gree) Fol 


k+1?k k=1 k=1 


]. Since the collection 


Since the series )71/(k + 1) diverges, we have fi, ,) gdA = 00. 


Exercises 10.7 


1. Let f be a nonnegative measurable function on a measurable set A. If 
J, f d\ =0, prove that f =0 a.e. on A. 


2. *a. Prove Theorem 10.7.4(b). 
b. Prove Theorem 10.7.4(c). 
3. Let A be a measurable subset of R. 


a. If f is integrable on A and g is bounded and measurable on A, prove 
that fg is integrable on A. 
b. If f and g are integrable on A, is the function fg integrable on A? 
4. *Let fp(x) =x”, x € (0,1). Prove that f, is integrable on (0,1) for all 
p,0<p<1, and that 
1 
fp dA = —. 
(0.1) op 
5. Define f on [1,00) by 


ney= {¥" if x € [n,n+1/n?), n=1,2,..., 


0 otherwise. 
Show that f € L([1,00)) but f? ¢ L£([1, 00)). 


6. Let P denote the Cantor set of Section 2.5. Define f on [0,1] as follows: 
f(x) = 0 for every x € P, and f(#) = k for each z in the open interval 
of length 1/3* on [0,1] \ P. Prove that f is integrable on [0,1] and that 


1 


ffdy=3. 


0 
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7. *Let f be a nonnegative integrable function on [a,b]. For each n € N, let 


={a:n< f(x) <n+1}. Prove that S> nA(En) < co. 
n=1 
8. Evaluate each of the following limits: 


a. lim (1-e7® /*)g 1/2 dx. b. lim (1—a/n)"e*/? dx. 


9. *Let f be an integrable function on [a, b]. Given € > 0, prove that there 


b 
exists a bounded measurable function g on [a,b] such that f | f—g| dA < e. 


10. *Suppose f is integrable on a measurable set A with A(A) = oo. Given 
€ > 0, prove that there exists a bounded measurable set EF C A such that 


i [f[dd <e. 
A\E 


11. Show by example that Fatou’s lemma is false if the functions f,, n € N, 
are not nonnegative. 


12. Show by example that the bounded convergence theorem is false for a 
measurable set A with (A) = oo. 


13. *Let f be a Lebesgue integrable function on a measurable set A. Prove 
that given e > 0, there exists a 6 > 0 such that 


[lfla<e 


for all measurable subsets EF of A with A(E) < 6. 


14. Let f be an integrable function on (a,b), where —co < a < b < oo. Define 
F on (a,b) by 


=f fdd, x E (a,b). 
a. Prove that F is continuous on (a, b). 


b. If f is continuous at x € (a,b), prove that F' is differentiable at x 
with F’(xo) = f (Xo). 


15. *If f € £([0,1]), show that pevely t € R the function x => sin(tf (x)) 
is in £((0,1]), and that g(t de sin(tf(x)) dX(x) is a differentiable 
function of t € R. Find g’(t). 


16. *If f € C(R), prove that lim / f(x) sinnadA = 0. 


noo JR 


17. Let f € £(R). 


a. Prove that f f(a+t)ddA = f f(x) dd. 
R R 


b. Prove that poy |f(w@+t) — f(x)| dA =0. 


18. Let f be a nonnegative measurable function on (a, }] satisfying f € Rc, b] 
for every c, a << c< b. Prove that 


[far tim, f f(2) ae 
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19. *(Monotone Convergence Theorem) Let {fn} be a monotone in- 
creasing sequence of nonnegative measurable functions on a measurable 
set A. Prove that 
fClim f,)d\ = lim f f,da. 

A n—->oco N70 A 

20. Show that the monotone convergence theorem is false for decreasing se- 
quences of measurable functions. 

21. *a. Let f be a nonnegative measurable function on a measurable set A, 
and let {A,} be a sequence of pairwise disjoint measurable subsets of A 
with U),, An = A. Prove that 

far= / fa. 
b. Prove that the conclusion of part (a) is still valid for arbitrary 
f € L(A). 

22. Let {fn} be a sequence of measurable functions on [a,b] satisfying 
|fn(x)| < g(x) a.e., where g is integrable on [a,b]. If lim fn(x) = f(x) 
exists a.e. on [a,b], and h is any bounded measurable function on {a, b], 
prove that 

b b 
/ fhddA = lim i fnhdx. 
a noo a 
23. *As in Exercise 4, Section 6.4, let f be defined on (0,1) by 
d : 
f(x) = a (x* sin 3). 
Prove that f is not Lebesgue integrable on (0, 1). 

24. Let f be a nonnegative measurable function on [a,b]. For each t > 0, let 

me (t) = A({a € [a,b] : f(a) > t}). 
a. Prove that m ;(t) is monotone decreasing on [0, 00). 
b ee) 
b. Prove that f fd\ = { mg (t) dt. 
a 0 
Se 


10.8 Square Integrable Functions 


In analogy with the space ¢? of square summable sequences, we define the 
space £? of square integrable functions as follows. 


DEFINITION 10.8.1 Let A be a measurable subset of R. We denote by 
L?(A) the set of all measurable functions f on A for which |f|? is integrable 
on A. For f € £L7(A), set 


isle = (f/ year) 
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The quantity || f||2 is called the 2-norm or norm of f. Clearly, ||f||2 > 0, 
and from the definition it follows that if f € £7(A) and ¢ € R, then cf € 
£?(A) with ||cf||2 = |cl||f||2- We will shortly prove that if f, g € £?7(A), then 
f+g«€L7(A) with ||f + glle < |lflle + \lgll2. Thus £?(A) is a vector space 
over R. 

If f € L7(A) satisfies || f||2 = 0, then by Exercise 1, Section 10.7, |f|? = 0 
a.e., and thus f = 0 ae. on A. This does not mean that f(x) = 0 for all 
x € A; only that f = 0 except on a set of measure zero. Thus || |l2 satisfies 
all the properties of a norm except for || f||2 = 0 if and only if f = 0. To get 
around this difficulty we will consider any two functions f and g in £?(A) for 
which f = g ae. as representing the same function. Formally, we define two 
measurable functions f and g on A to be equivalent if f = g a.e.. In this 
way it is possible to define £?(A) as the set of equivalence classes of square 
integrable functions on A. Rather than proceeding in this formal fashion, we 
will take the customary approach of simply saying that two functions in L? 
are equal if and only if they are equal almost everywhere. With this definition 
£?(A) is a normed linear space. 


EXAMPLES 10.8.2 

(a) For our first example let f(x) = 1//zx, x € (0,1). By Exercise 4 of 
Section 10.7, f is integrable on (0,1) with ie f d\ = 2. Since f?(x) = 1/2, by 
Example 10.7.3(a), f? is not integrable on (0,1) and thus f ¢ £?((0,1)). On 
the other hand, if g(x) = 2~'/3, then g?(a) = «2/3, which by Exercise 4 of 
the previous section is integrable. Thus g € £7((0,1)) with 


1 
I913 =f 2? ae=3. 
0 


(b) Consider the function f(x) = 1/x for x € [1, 00). For anyn € N, n > 2, 
n 7 n = 1 
i: yas fz ae = |1- =). 
1 1 u 


If1B= flax = jim ffPar =a 


Therefore f € £7([1,00)) with || f||2 = 1. It is easily shown that f ¢ L([1,0o)). 


Thus 


Cauchy-Schwarz Inequality 


Our first result will be the analogue of the Cauchy-Schwarz inequality for @?. 
The following inequality is sometimes also referred to as Holder’s inequality. 
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THEOREM 10.8.3 (Cauchy-Schwarz Inequality) Let A be a measur- 
able subset of R. If f, g € L(A), then fg is integrable on A with 


| Lfgl @ < [Ifllallglle. 
A 


Proof. By Theorem 10.5.4, the product fg is measurable, and for any x € A, 
we have 


|f(x)g(a)| < ssa)? + |9(2)|?). 


Since by hypothesis f, g € L?(A), the function |fg| is integrable on A, and 
thus fg is integrable on A. As in the proof of Theorem 7.4.3, for y € R 


o< f (Fl— lob? = IF + lal - 27 f Ifalaa. (10) 


If ||gll2 = 0, then by Exercise 1 of Section 10.7, g = 0 ae. on A. Asa 
consequence, f,|fg|dA = 0, and the conclusion holds. If ||gl|z2 4 0, set 
y= (J, | fg dA)/|lg\|3. With 7 as defined, (10) becomes 


(Ja lfg| dd)? 


’ 


and thus (J), |fg| dA)? < || f||3||g\]3, which proves the result. 


Our next result is Minkowski’s inequality for the space £?. Since the proof 
of this is identical to the proof of Theorem 7.4.5, we leave the details to the 
exercises. 


THEOREM 10.8.4 (Minkowski’s Inequality) Let A be a measurable 
subset of R. If f, g € £L7(A), then f +g € L7(A) with 


lf + gllo < Ilfllo + Ilglle- 


Proof. Exercise 4. 


The Normed Linear Space L?({a, }]) 


If A is a measurable subset of R, the norm || ||2 on L(A) satisfies the 
following properties: 

(a) [fll > 0 for any f € £2(A). 

(b) || fll2 = 0 if and only if f =0 ae. on A. 

(c) |lcf|l2 = |el||fll2 for all f € L7(A) andceR. 

(d) If + gll2 < IIflle + lIglle for all f, g € £?(A). 
Properties (a) and (c) follow from the definition, and (d) is Minkowski’s in- 
equality. With the convention that two functions f and g are equal if and 
only if f = g a.e., £7(A) is a normed linear space. 
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By Definition 8.3.9, a sequence { f,,} in £L? converges to a function f in L? 
if and only if lim || f— fn|lg = 0. Example 10.6.12(b) shows that convergence 
noo 


in L? does not imply pointwise convergence of the sequence. As in Chapter 
9, convergence in L? is usually called convergence in the mean (or norm 
convergence). We now prove that £7([a,b]) is a complete normed linear 
space. 


THEOREM 10.8.5 The normed linear space (L7({a,6]), || ||2) is complete. 


Remark. Although we state and prove the result for a closed and bounded 
interval, the same method of proof will work for £?(A) where A is any mea- 
surable subset of R. 


Before proving the theorem, we first state and prove the following lemma. 


LEMMA 10.8.6 Let A be a measurable subset of R. Suppose { f;,} is a mono- 
tone increasing sequence of nonnegative measurable functions on A satisfying 


| fndrdA < C, for alin EN, 

A 

and for some finite constant C'. Then f(x) = lim fn(x) is finite a.e. on A. 
Nn—-Oo 


Proof. Since {f,(2)} is monotone increasing for each « € A, the sequence 
either converges to a real number or diverges to oo. Let f(z) = lim f,,(x), 
n—->co 


and let 
E={xeA: f(x) =o}. 


We will prove that \(Z) = 0. For each k € N, let 
Ey, ={x Ee A: f(x) > k}. 
Then Ey > Exyi for all k € N with (), cy Ex = LE. For fixed k €N, set 
Ann = {x © A: fr(x) > k}, neéeN. 


Then An~ C An+i,k with U Anh = Ex. Thus by Theorem 10.4.6(a), 


nen 


1 
MAn.t) =| Las pf ir<5 ef poe’ 
An,k 
Therefore \(Ex) < C/k for allk EN. Sics A(E) < 00, by Theorem 10.4.6(b), 


Therefore f is finite a.e. on A. 
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Proof of Theorem 10.8.5. Let {f,} be a Cauchy sequence in £7. Then 
given € > 0, there exists ny € N such that || fn, — fm|l2 < ¢ for all n, m > no. 
For each k € N, let nz be the smallest integer such that || fm — fnll2 < 1/2* 
for all m,n > ny. Then ny < ng < +++ Sng <-+-+, and 


1 
II Frvtep _ Fry |le < DR 


For each k € N, set 


9k = |fril + |fnz fal eee} Fries tak 


By Minkowski’s inequality, 


k 
[9840 = lo < [falls + 3 Mayes ~ fol 
a, j=l 
2 


k 
< [fnlla + > se} < (Mfmlle +1). 
j=l 


Thus the sequence {g?} satisfies the hypothesis of Lemma 10.8.6. Therefore 
jim gj is finite a.e. on [a,b]. But then jim gk is also finite a.e. on [a,b]. As a 
00 0° 


consequence the series 
[fn (a N+ DE iol — fn, (2)| 
converges a.e. on [a,b], and therefore so does the series 
co 
Fy (2) + 9) fnsss(@) — fn, (2))- 
j=l 


But the kth partial sum of this series is f,,,,(%). Therefore the sequence 
{fn }ren converges a.e. on [a,b]. Let E denote the set of x € [a,b] for which 
this sequence converges. Then ((a, 6] \ £) = 0. Define 


(xz) = {e Fx (a), ee 


f 


0, otherwise. 


Then { fn, } converges to f a.e. on [a,b]. 


It remains to be shown that f € £7, and that {f,,} converges to f in L?. 
Since 


k 
fret < Frail +S¢ ra _ tal = Gk; 


qe 
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by Fatou’s lemma 


jf lsPax stim oh <0o 
[2,0] 


k-oo J [a,b] 
Thus f € £2. Finally, since 
JAD) = Fong (2) = fim fry (®) — fre (2) a.€., 


by Fatou’s lemma again, 


; ee 
/ If — fngl?dd < Tim [Frias — fry? (=) 7 
[a,b] Joo [a,b] 
Therefore || f — fn, |l2 < 1/2* for all k € N. Thus the subsequence {f,, teen 
converges to f in the norm of £L?. Finally by the triangle inequality, 


If — Falla SIF ~ foulle + linu ~ falla < gg + Wifna ~ Salle 


From this it now follows that the original sequence {f,,} also converges to f 
in the norm of L?. 


Fourier Series 


We close this chapter by making a few observations about Fourier series and 
the space £7([—7,7]). As in Definition 9.3.1, if f is Lebesgue integrable on 
[—7, m], the Fourier coefficients of f with respect to the orthogonal system 
{1, cos nz, sinnx}°°, are given by 


1 Tv 
an = — f(x)cosnadz, n=0,1,2,..., 
T Jan 
1 as 
by, == f(x)sinnadz, n=1,2,... 
T Jer 


Since f is Lebesgue integrable, the functions f(x) sinna and f(x) cosnx are 
measurable on [—7, 7], and in absolute value less than or equal to | f(a)|. Thus 
the functions f(x) cosnx and f(x) sinnz are all integrable on [—7, 7]. 

The same method of proof used in proving Bessel’s inequality for Riemann 
integrable functions proves the following (Exercise 8): If f € £?({—7,7]) and 
{a,} and {b;} are the Fourier coefficients of f, then 


1 = i ia 
520 ) az +be < = Tf aX (Bessel’s Inequality) 
k=1 ae 


Thus the sequences {az }?2.,) and {by }72, are square summable. We now use 
completeness of the space £?([—7,7]) to prove the converse. 
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THEOREM 10.8.7 Jf {ax}? and {bi}, are any sequences of real num- 
bers satisfying 


1 [oe) 
5 + Dae + Of < 00, 
k=1 
then there exists f € L*([—m,7]) whose Fourier coefficients are precisely {ax} 
and {by}. 


Proof. For each n € N, set 


1 n 
Sp(a) = 540 + S- ax coska + by sin ka. 
k=1 


Since each S,, is continuous, S,, is square integrable on [—7, 7]. If m < n, then 


2 


Sn —Smlf3 = f [> a, coska + by sinkx| daz 


—T Lk=m-+1 
which by orthogonality 
n 
= ys (az + 62). 
k=m+1 


Since the series converges, the sequence {$,,} is a Cauchy sequence in 

L?([-7,7]). Thus by Theorem 10.8.5, there exists a function f € £?({—7, 7]) 

such that S,, converges to f in L?; i.e., lim || f — Sp|l2 = 0. If n > m, then 
n—->oco 


Tv a 


Sp(x) cosmax dx = Tam and Sn (x) sinma dx = 1b. 
Therefore 
1 1 


Tv —T 


eye J(e) cos mde ~ a - qf (f(a) — Sn(x)) cos ma dx 


which by the Cauchy-Schwarz inequality 
it 
Jr 


Since this holds for all n > m, letting n — co gives 


< = [If — Sulla cosmalla = FIL ~ Sulla 


1 as 
am = — f(x) cos mea da. 
T Ji 


A similar argument proves that the b,, are the sine coefficients of f. 
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Is every Trigonometric Series a Fourier Series? 

co Si 
In Section 9.3 we showed that the series 5> 
for all 2 € R, is not the Fourier series of " Riemann integrable function on 
[—7, a]. Since S>(Inn)~? = ov, by Bessel’s inequality it is also not the Fourier 
series of a square integrable function. This however does not rule out the 
possibility that it is the Fourier series of a Lebesgue integrable function. The 
following interesting classical result is very useful in providing an answer to 
this question. Since the proof of the theorem is beyond the level of this text, 
we state the result without proof.” 


= even though it converges 


THEOREM 10.8.8 
lore) Br 
n d > 3 th 
(a) If b, > 0 for alin an SS oo, then 


n=1 


co 
y by, sinnx 
n=1 


is not the Fourier series of a Lebesgue integrable function. 


(b) If {a,} is a sequence of nonnegative real numbers with lim a, = 0, 


n> oco 


satisfying Gn < 4(dn—1+4n41), then the series 


2 
ioe) 
; An COS NX 
n=1 


is the Fourier series of a nonnegative Lebesgue integrable function on [—n, 7]. 


co 1 
s 
Since the sequence {1/(Inn)} satisfies hypothesis (a), the series } 7 ie 
n=2 Inn 


is not the Fourier series of any integrable function on [—7,7]. However, it is 
interesting to note that the sequence {1/(Inm)} also satisfies hypothesis (b) 
(Exercise 13), and thus the series 


is the Fourier series of a nonnegative Lebesgue integrable function. 


2A proof of the result can be found in Chapter V of the text by Zygmund. 


526 Introduction to Real Analysis 


Exercises 10.8 
1. *For x € (0,1) let fp(x) = 2”, p > 0. Determine all values of p such 
that fp € L°((0,1)). 
2. For each n € N, let In = (n,n + 1/n?). For a given sequence {cn} of 
real numbers, define f on [1,00) by f(#) = >> enxz, (x). Show that 
n=1 
2 


f € L*((1,00)) if and only if p2i < <0. 


3. Find an example of a real-valued function f on (0,00) such that f? is 
integrable on (0,00), but |f|? is not integrable on (0,00) for any p, 0 < 
p<, pF 2. 


(Hint: Consider the function g(x) = ae may? 
4. *Prove Theorem 10.8.4. 


Let A be a measurable subset of R with \(A) < oo. If f € £7(A), prove 
that f € L(A) with 


i LFldd < [[flla(a(a))”?. 


6. Let {fn} be a sequence in £°([a,b]). Suppose {fn} converges in L? to 
f € L? and {fn} converges a.e. to some measurable function g. Prove 
that f = g a.e. on {a, 6]. 


7. *Let {fn} be a sequence in £7(A) that converges in £L? to a function 
f €£°(A). If g € L(A), prove that 


lim fag dd = f fgd. 


8. If f € £L°([-7,7]) and {ax} and {b,} are the Fourier coefficients of f, 


prove that 

1 = if 

540 tS az tbe < f? dd. 
k=1 T Jon 


9. Which of the following trigonometric series are Fourier series of an L? 
function? 
cos nx SS sinnx  cosnx 
n=1 n n=1 Jn n=2 J/ninn 
10. Suppose F is a measurable subset of (—7,7) with \(F) > 0. Prove that 
for each 6 > 0, there exist at most finitely many integers n such that 
sinna > 6 for allz € E. 


11. Let f € £?([a, b]). Prove that given € > 0, there exists a continuous func- 
tion g on [a, b] such that || f —gl|l2 < ¢. (Hint: First prove that there exists 
a simple function having the desired properties, and then use Exercise 
15, Section 10.6, and Lemma 9.4.8.) 


12. For f € £L?([-7,7]), let {a,} and {b,} be the Fourier coefficients of f. 


a. Prove Parseval’s equality: 
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le wo. 1 [" 2p 
ga + Dak + bk ff dX. 
b. If ax = b, = 0 for all k, prove that f = 0 ae. 
13. *Show that the sequence {1/(Inn)} satisfies the hypothesis of Theorem 
10.8.8(b). 


14. Let {¢x}%2, be an orthonormal family in £((a,b]). If {c,}?2, € &, 
prove that there exists a function f € £7({a,b]) such that cx, = (f, or). 


Furthermore, for this f, lim ||sn — f|l2 = 0, where sn = >> cede. 


Notes 


Lebesgue’s development of the theory of measure and integration was one of the 
great mathematical achievements of the twentieth century. His proof that every 
bounded measurable function is Lebesgue integrable was based on the new idea of 
partitioning the range of a function, rather than its domain. Lebesgue’s theory of 
integration also permitted him to provide necessary and sufficient conditions for 
Riemann integrability of a bounded function /f. 

In addition to the fact that the Lebesgue integral enlarged the family of integrable 
functions, the power of the Lebesgue integral results from the ease with which it 
handles the interchange of limits and integration. For the Riemann integral, uniform 
convergence of the sequence { f,} is required. Otherwise, the limit function may not 
be Riemann integrable. On the other hand, if {fn} is a sequence of measurable 
functions on [a,b], then its pointwise limit f is also measurable. Hence if f is also 
bounded, then f is integrable. The bounded convergence theorem is notable for its 
simplicity of hypotheses and proof. It only requires that {f,} be uniformly bounded 
and converge a.e. on [a, 6]. This is sufficient to ensure that 


lim ie / (lim fn) dd. 
[a,b] [a 


n— oo .b] n—-oco 


With the additional hypothesis that the pointwise limit f is Riemann integrable, 
the bounded convergence theorem is also applicable to a sequence {fn} of Riemann 
integrable functions. 

The bounded convergence theorem, or the dominated convergence theorem, are 
also the tools required to prove the fundamental theorem of calculus for the Lebesgue 
integral. 


Theorem A If f is differentiable and f’ is bounded on [a, b], then f’ is Lebesgue 
integrable, and i f'dd = f(b) — f(a). 

The proof of this result was requested in Exercise 8 of Section 10.6 . It fol- 
lows simply by applying the bounded convergence theorem to the sequence {gn} 
defined by gn(x) = n[f(a + +) — f(«)]. Since f is differentiable, the sequence {gn} 
converges pointwise to f. Also, by the mean value theorem the sequences {gn } is uni- 
formly bounded on |a, b]. This then establishes the analogue of Theorem 6.3.2 for the 
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Lebesgue integral. If instead of bounded, one assumes that f’ is Lebesgue integrable, 
then the result also follows by Lebesgue’s dominated convergence theorem. 

The Riemann ae of integration allows us to prove that if f € R[a,b], and 
F is defined by F(x) = f” f(t)dt, then F’(x) = f(x) at any x € [a,6] at which f 
is continuous. ies : € Ra, b] if and only if f is continuous a.e. on [a,b], we have 
that F’(x) = f(x) a.e. on [a,b]. Although not proved in the text, this result is still 
valid for the Lebesgue integral. 


Theorem B Let f be Lebesgue integrable on [a,b], and define F(x =f. fan: 
Then F’(x) = f(x) ae. [a,b]. 


By writing f = f* — f-, it suffices to assume that f > 0, and thus F is 
monotone increasing on [a,b]. It is a fact independent of integration that every 
monotone function is differentiable a.e. on [a, b].° A slight generalization of Theorem 


A then gives that 
[ F'd\ = F(a a= fo fa, 


or that {”[F’— f] dA = 0 for all x € [a, b]. As a consequence of Miscellaneous Exercise 
5 we have F’ = f a.e. Newton and Leibniz realized the inverse relationship of 
differentiation and integration. The above two versions of the fundamental theorem 
of calculus provide a rigorous formulation of this inverse relationship for a large class 
of functions. 

The Lebesgue theory of integration also provides the proper setting for the study 
of Fourier series. The bounded convergence theorem was used by Lebesgue to prove 
uniqueness of a Fourier series. If 


f(x) = 540 + SS (Ak coska + By sinka), 


for all « € [—7,7], then f, being the pointwise limit of a sequence of continuous 
functions, is automatically measurable on [—7, 7]. If f is also bounded, then f is in- 
tegrable. If the sequence {S;,} of partial sums of the trigonometric series is uniformly 
bounded, then by the bounded convergence theorem, the trigonometric series is the 
Fourier series of f. In his 1903 paper, “Sur les series trigonometric,” * Lebesgue 
showed that uniform boundedness of the partial sums may be removed; that bound- 
edness of the function f itself was sufficient. This result was extended in 1912 by de 
la Vallée-Poussin” to the case were the function f is integrable on [—7, 7]. The reader 
is referred to the article by Alan Gluchoff for an overview of how trigonometric series 
has influenced the various theories of integration. 


3See page 208 of the text by Natanson. 

4 Annales Scientifiques de V’Ecole Normale Supérieure, (3)20 (1903), 453-485. 

5“Sur Punicité du développement trigonométrique,” Bull de l’Acad. Royale de Belgique 
(1912), 702-718; see also Chapter 9 of the text by Zygmund. 
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Micellaneous Exercises 
1. Let A be a measurable subset of R. For f € £(A) set 


ne [ria. 


Prove that (£(A), || ||1) is a complete normed linear space. 
2. Let A be a measurable subset of R, and let f, fr,n = 1,2,... be measur- 


able functions on A. The sequence {f, } is said to converge in measure 
to f if for every 6 > 0, 


limp oo A({a € A: | fn(x) — f(x)| > d}) =0. 
a. If {fn} is a sequence in £(A), and {fn} converges in the norm of £(A) 
to f € L(A), prove that {fn} converges in measure to f. 


b. Find a sequence { fn} of measurable functions on a measurable set A 
that converges to a function f in measure, but does not converge to f in 
norm. 


c. If (A) is finite and {f,} is a sequence of measurable functions that 
converges in measure to a measurable function f, prove that there exists 
a subsequence {f,,,} of {f,} such that f,, > f a.e. on A. 

d. Show that the sequence { f;,} of Example 10.6.12(b) converges to 0 in 
measure. 

e. Find a sequence { fn} of measurable functions on a measurable set A 
such that f, — 0 everywhere on A but {f,} does not converge to 0 in 
measure. 


3. Let {yn} be a sequence of orthogonal functions on [a, b] having the prop- 
b 
erty that the only continuous real-valued function f satisfying f fiyndA = 


0 for all n EN, is the zero function. Prove that the system {yn} is com- 
plete. (Hint: First use the hypothesis to prove that if f € £?((a, b]) satis- 
b 


fies f fn dA = 0 for all n € N then f = 0 a.e. Next use completeness of 


L? to prove that Parseval’s equality holds for every f € £°((a, 6]).) 


4. (Construction of a Nonmeasurable Set) For each x € [-4, 4), define 
the set K(x) by 


K(x) = {y€ [-3, 3] :y— © € Qh. 

a. Prove that for any x, y € [—4, 4], either K(x) K(y) =0 or K(x) = 
K(y). (Note: K(x) = K(y) does not imply that 2 = y; it only implies 
that x — y is rational). 


Consider the family F = {K(ax) : x € [—4,4]} of disjoint subsets of 
[-4, 3). Choose one point from each distinct set in this family and let A 
denote the set of points selected. The ability to choose such a point from 


each of the disjoint sets requires an axiom from set theory known as the 
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axiom of choice. Further information about this very important axiom 
can be found in the text by Halmos. 


Let rz, k = 0,1,2,..., be an enumeration of the rationals in [—1, 1], with 
ro = 0, and for each k = 0,1,2.., set Ay =A+rp. 


b. Show that the collection {Ax} is pairwise disjoint with [—4, 4] C 
Uzzo Ae C [-3, 3]. 

c. Use the above to show that A,(A) = 0 and A*(A) > 0, thus proving 
that A is nonmeasurable. 


Suppose f is Lebesgue integrable on |[a, 6]. If fe f dX = 0 for every x € 


[a,b], prove that f = 0 ae.. 
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Chapter 1 


Exercises 1.1 page 5 

2. (a) ANB = B, ANZ = {-1,0,1,2,3,4,5}, BNC = {2:2<2< 3}. (b) 
Ax B={(az,y):-l<«<5,0<y< 3}. 4. (a) Suppose x € AN(BNC). 
Then « € Aandx Ee BNC. SinceexE€ BNC, x € BandxeC. Thusxe ANB 
and x € C. Therefore x € (AN B)NC. This proves AN(BNC) Cc (AN B)NC. 
The reverse containment is proved similarly. 7.(a) Let « € AU(BNMC). Then 
zxé€Aorxé€ BNC. If « € A, then & € AUB and « € AUC. Therefore 
x €(AUB)N(AUC). Ifxe BNC, then z € B and x € C. Hence x € AUB and 
x € AUC, ie, « € (AUB)N(AUC). Thus AU(BNC) Cc (AUB)N(AUC). The 
reverse containment is proved similarly. (c) Let c € C\ (ANB). Then x € C and 
x¢ ANB. Sincex €ANBwehavex¢Aorx¢G B.Ifa¢ AthenceC\A. 
Likewise, if « ¢ B, then x € C \ B. In either case, x € (C \ A) U(C \ B). Therefore 
C\ (ANB) Cc (C\ A) U(C\ B). The reverse containment is proved similarly. 

8. If A = {1,2,3} then P(A) = {0, {1}, {2}, {3}, {1, 2}, {1, 3}, {2,3}, A}. 11. Let 
(x,y) € Ax (Bi U Bo). Then x € A and y € By, U Bo. Thus x € A and y € B; or 
y € Bo. If y € By then (a,y) € A x By. If y € Bo, then (x,y) € A x Bo. In either 
case, (x,y) € (A x B1) U(A x Be). The reverse containment is proved similarly. 


Exercises 1.2 page 14 


1. (b) No. The ordered pairs (1,—1) and (1,3) contradict the definition of function. 
(d) In terms of ordered pairs k = {—1, 1), (0,3), (1,5), (4, 7)} and thus is a function 
from A into B. 2. (a) No! The ordered pairs (0,1) and (0,—1) are both elements 
of A. This however contradicts the definition of function. 3. (a) f({1,2,3,4}) = 
{1,3,5, 7} and james 2,3,4}) = {1.2}. 4. (a) f(A) = {y: 0 < y < 9}; f(A) > 
{e:e® +16 A}={a:-W3<a<1}. (c) f(a) = YI, ceR. 

5. (b) For k EN, (fog)(k) = 2k+3. Therefore (fog)(N) = {2k+3:k =1,2,3,...} 
which is the set of odd integers greater or equal to 5. 6. (b) Range f = R, f is 
one-to-one, and « = f~'(y) = $(y+2). (e) Range f =R, f is not one-to-one: If 
vi # yo, then (x, yn) ¥ (2, ye) for any a, yet f(x, y1) = f(w, 42). 

(f) Range f = {y: 5 <y < 1}. f is not one-to-one. If 0 < z < 1, then f(—z) = 
f(x). 7. (a) Rangef = {(2,y) € RXR: a? +y? = 1}. (b) f77((1,0)) = 
0, f-*((0,-1)) = #2. 11. Assume f is not one-to-one and show that this leads to 
a contradiction. 


Exercises 1.3 page 20 


1. (b) For n= 1, 1=1?. Assume the result is true for n = k. Then forn =k +1, 
14+3+5+---+(2k—-1)+(2(k+1)—-1) = k?+(2k+1) = (k4+1)?. (d) Whenn = 1, 
1° = [3-1-2]. Assume true for n = k. Then for n = k+1, 1°7+2°+---+k?+(k+1)? = 
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(k+1)° = $(k4+1)?(k? +4k +4) = [$(k+1)(k+2)]?. (£) When 
n=1, 2? —y? =(x—y)(x + y) and equality holds. For n = k + 1 write 

yt? = ght2 qyktl 4 pak tl ykt2 — (ght yk+l) 4 (gp y)yk+1, and now 
apply the induction hypothesis. 2. (a) The result is true for n = 1. Assume that for 
k EN, 2® > k. Then by the induction hypothesis, 2*t! = 2°.2>k-2=k+k>k+4+1. 
(c) For n = 4, 4! = 24 > 16 = 2°. Thus the inequality is true when n = 4. Assume 
that n! > 2” for some n > 4. Then (n +1)! = (n+1)n! > (n+1)2” > 2-2" = 2741. 
Thus by the modified principle of mathematical induction the inequality holds for 
alné€N,n>4. (d) True for n = 3. Assume true for k > 3. Then forn=k+1, 
P+. +kh2 4 (kK +1)? < $k°4 (K+ 1)% = S[k* + 2k? + 6K? + 6K + 2]. 
But for k > 2, 6k +2 < 4k +1+ 2k from which the result now follows. 4. For 
n € N let P(n) be the statement f(n) = 3-2" 4 (—1)". Then P(n) is true for 
n=1, 2. For k > 3, assume that P(j) is true for all 7 € N, 7 < k. Use the fact that 
f(k) = 2f(k —2)+ f(k—1) and the induction hypothesis to show that P(k) is true. 
Thus by the second principle of mathematical induction the result holds 

for alln € N. 5. (b) f(n) = n?. (d) f(n) = 0 if n is even and f(n) = 
(-1)-D? fn! ifmisodd. (f) f(2k+1) = mem and f(2k) = seg a2. These can 
be proved by induction on k. 7. For each n € N let S, =r+ pr? ..s +r”. Then 
Sn—TSn = r—r"*?, from which the result follows. 8. Hint: Let A = +(a1 +---+an) 
and write an41 = xA for some x > 0. Use the induction hypothesis to prove that 
(Q1+-+-Gn- ee hie < x'/("+)) 4. Now use Bernoulli’s inequality to prove that 
aV@+) < (n+2)/(n +1). From this it now follows that 

pli D ye Oy 
~n+i1 n+1 
Exercises 1.4. page 28 
4. (a) Consider (a—b)?. 5. (a) inf A=0,supA=1. (ce) infC =0, supC = oo. 
(f) infF = 1, supe = 3. (h) inf H = —2,supH = 2 8. Apply Theorem 
1.4.4. 14. (b) Since A and B are non-empty and bounded above, a = sup A and 
8 = sup B both exist in R. Since a = sup A we have a < a for all a € A. Similarly 
b < 6 for all b € B. Thereforea+b<a+ for alla € A,be€ B. Thusa+ 8 
is an upper bound for A+ B, and thus y = sup(A + B) < a+ 8. To prove the 
reverse inequality, we first note that since y is an upper bound for A+ B,a+b<+¥ 
for alla € A,b € B. Let b ©€ B be arbitrary, but fixed. Then a < y — 6 for all 
a € A. Thus y — 6 is an upper bound for A and hence a < ¥ — b. Since this holds 
for all b € B, we also have that b < y—a for all b € B. Thus 8 < y—- a; ie., 
a+ B<y. 15. (a) Let a = sup{f(x) : « € X}, 8 = sup{g(x) : x € X}. since 
the range of f and g are bounded, a and £# are finite with f(x) + g(x) < a+ 8 
for every « € X. Therefore a + 8 is an upper bound for {f(x) + g(a) : « € X}. 
Thus sup{f(z) + g(a): 2 €X}<a+ 6. (d) Let a = sup{g(xz) : « € X}. Hence 
g(x) < @ for all « € X. Thus by hypothesis f(x) < a for all « € X. Therefore a 
is an upper bound for { f(x) : « € X}. As a consequence sup{f(x) : 2 € x} <a. 
16. (a) F(x) = 30 +2, sup{F(x): x € [0,1]}=5. (c) Range f = [0,5]. Therefore 
sup{f(z,y):(a,y) eX xY}=5. 20. (a) F(x) = 3a +2 and A(y) = 2y. Thus 
sup{H(y) : y € [0,1]} = 2 and inf{F (x): x € [0,1]} =2. 


(a1 tess + An 4 Qn+1)- 


Exercises 1.5. page 32 

1. First prove that if p and q are positive integers then there exists n € N such that 
np > q. Ifp > q then n = 1 works. If p < q, consider (q+ 1)p. 4. Suppose ri, r2 
are rational with r1 < ro. Then rg —1r1 > O and r=7) + $(r2 —r1) is rational with 
ro<r<ro. 6. (a) Use the fact 2/2 is irrational. (b) Use Theorem 1.5.2 and 
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(a). 8. Since x < y and u > 0, we have x/u < y/u. Now apply Theorem 1.5.2 and 
(a). 


Exercises 1.6. page 36 


1. (a) .0202020... 2. (c) 0101 = 4+ 4 =2. (d) .010101---=3+4+ 

a cea C4)" = + [24] =}. (f) .001001---=3+4+4+-° 5 

3 2X (3)" = 3 [2] = a 3. (a) .0022 = 3 z 3 a = rd i a Fl 

(d) .101010--- =44+3+44+24+¢4+-:-=4 (3) =3 [ts =2. (f) 
n=0 

tad = 3 ter + Soe =F EG) +8 SG Aa a+b HE 

4. .010101---. 5. Finite binary expansion is .0011 whereas the infinite binary 


expansion is .0010111---. 


Exercises 1.7. page 45 

1. (c) Let f : N— O be defined by f(n) = 2n—1. 4. (a) g(x) = a+a(b—a) is a one- 
to-one mapping of (0,1) onto (a,b). 6. (a) Since A ~ X, there exists a one-to-one 
function h from A onto X. Similarly, there exists a one-to-one function g from B onto 
Y. To prove the result, show that F': Ax B + X xY defined by F(a, b) = (h(a), g(b)) 
is one-to-one and onto. 8. (a) JAn =R, (\An = {x:-1<a< 1}. 

(c) UAn = (1,2), (An = [0,1]. (e) UAn = (0,1), An = {43}. 12. (a) Let 
y € f(Uaka). Then y = f(x) for some x € UaEa. But then x € Eq for some a. 
Therefore y = f(x) € f(Ea). Thus f(UaEa) C Uaf (Ea). The reverse containment 
follows similarly. 13. (b) Since the set of rational number Q is countable and 
the set of real numbers R is uncountable, by part (a) the set of irrational numbers, 
namely R \ Q, is uncountable. 15. (a) For n € N let P, denote the set of all 
polynomials in x of degree less than or equal to n with rational coefficients, and let 
Q”*! =Qx---xQ (n+1 times). By repeated application of Exercise 6 (b), Q"*? is 
countable. Define f : Q”"t' + Py, by f(ao,@1,--.,;@n) = Q@n2” ++--+a12 +49. Since 
f maps Q"*! onto P, and P, is infinite, P, is countable. (b) By part (a) Pr is 
countable. Thus by Theorem 1.7.15, Un Pn, the set of all polynomials with rational 
coefficients, is countable. 18. (a) Consider the function on (0,1) that for each 
néEN, n> 2, maps 4 to —., and is the identity mapping elsewhere. 19. For a 


n-1? 
polynomial p(x) = anxz” +---+ aia + ao, consider the height h of the polynomial 
defined by h = n+|ao| + |ai| +--+ |an|. Prove that there are only a finite number of 


polynomials with integer coefficients of a given height h, and therefore only a finite 
number of algebraic numbers arising from polynomials of a given height h. 22. If 
f is a function from A — P(A), show that f is not onto by considering the set 
{xe A:a¢ f(x)}. 23. For a,b € [0,1] with decimal expansion a = .a,a2... and 
b = .b1b2..., consider the function f : [0,1] x [0,1] > [0, 1] by f(a,b) = .a1biagbe.... 


Chapter 2 


Exercises 2.1. page 56 

2. (b) We first note that |z| = |e—y+y| < |e—y|+|y|. Therefore |2|—|y| < |a—y|. 
Interchanging x and y gives |y| — |x| < |y — z| = |x — y|. Now use the definition of 
|lz] —ly||. 5. (a) -8< a < 18/3. (ce) -1 <a <2. 7. (c) This is a metric. 
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The only nontrivial part is the triangle inequality. This follows from the following. 
Since the In function is increasing on (0,00), for a, b positive we have 

In(1+a+b) < In((1+a)(1+6)) = In(1+a)+In(1+ 8). 

11. (a)(i) Since the points are collinear, the distance is just the usual euclidean 
distance, i.e. d(($,4),(-3,-G)) = $V5. (ii) The points are not collinear. So 
d((4, 4), (0,1)) = $V2+1. 12. (b) For x € [0,1], |z — | = x — 2’, which has 
a maximum at x7 = 3. Therefore d(f,g) = i. 14. Again the only non-trivial part is 


the triangle inequality and it follows from the following: for a,b positive, 
a+b a b a 


l+ta+b 1+a+b 1+a+b7~ l+a 
Exercises 2.2. page 67 


2. Let p€ O = U, Oa be arbitrary. Then p € Oa, for some ao € A. Since Oa, 
is open, there exists « > 0 such that Ne(p) C Oa,. But then Ne(p) C O; i.e., p is 
an interior point of O. 3. (a) By Corollary 2.2.16 a finite set has no limit points. 
Now apply Theorem 2.2.14. This can also be proved directly by showing that the 
complement of a finite set is the finite union of open intervals. 

5. (b) Since \/x? + #2 < |a1| + |a2| we obtain N2(p) C N2(p). Likewise, since 
max{|a1|, |v2|} < \/x? + 22 it follows that N2(p) C N&°(p). The last containment 
follows since |x| + |v2| < 2max{|x|,|rv2|}. 8. (a) For E = (0,1) U {2}, Int BE = 
(0,1), EB’ = [0,1], isolated points = {2}, B = [0,1] U{2}. (d) Fork={4+:ne 
N}, Int(Z) =, E’ = {0}, isolated points = E, H = EU{O0}. 9. (a) {a,b}. 

13. (a) Closed in X. (c) Neither. 16. Since a ¢ A, for every € > 0 there exists 
an a € A such that a —€ < a < a. Therefore a is a limit point of A. 17. (a) 
Let p € Int(£) be arbitrary. Since p is an interior point of F, there exists an « > 0 
such that N.(p) C E. To show that N.(p) C Int(£) it remains to be shown that 
every q € N-(p) is an interior point of E. 19. (a) Since AU B is a subset of AUB 
(which is closed), by Theorem 2.2.18(c) AUB Cc AUB. The reverse containment 
follows analogously. 22. Let {rn}?2 1 be an enumeration of Q, and f{e,}%2, an 
enumeration of the positive rational numbers. Take Z = {Ne, (rn) : 7, n € N}. 

23. Suppose U C R is open and suppose FE Cc U is open in U. Let p € E be arbitrary. 
Use the fact that EF is open in U and that U is open to show that there exists an € > 0 
such that Ne(p) C E. Thus p is an interior point of E. Since p € EF was arbitrary, 
E is open in R. The converse is obvious. 25. (a) Let U = (0,1) and V = (3, 3). 
26. Hint: Use the fact that A = AU A’, and if U open satisfies UM A’ # @ then 
UNA. 27. Let A be a non-empty subset of R. If A contains at least two points 
and is not an interval, then there exist r, s € A withr <sandt€ Rwithr<t<-s, 
but t ¢ A. The open sets U = (—oo,t) and V = (t,co) will prove that A is not 
connected. Therefore, every connected set is an interval. Conversely, suppose A is 
an interval and A is not connected. Then there exist disjoint open sets U and V 
with ANU #0, ANV £90, and A CUUV. Suppose a€ ANU and be ANV. By 
Theorem 2.2.20 applied to U and V there exist disjoint open intervals J and J such 
that a € I and b € J. Suppose a < b and J = (t,s). Show that t ¢ UUV, but t € A. 
This contradiction proves that A is connected. 


1+b 


Exercises 2.3. page 73 

1. (b) Use the fact that 0 is a limit point of A. 3. (a) Let U = {Uahaca be an 
open cover of AU B. Then U/ is also an open cover of A and B, respectively. Now 
use the compactness of A and B to obtain a finite subcover of AUB. 4. Since 
K is compact, by Theorem 2.3.5 Kk is closed. Now show that K is bounded. Let 
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a = sup kK. This exists since K is non-empty and bounded. Now use the fact that 
K is closed to show that a € K. 


Exercises 2.4. page 76 

1. Take Kk, = [0,n]. 3. Suppose I, = [an, bn]. Since In D I for all m > n, we 
have dn < Gm < bm < bn for all m > n. Let a = sup{an} and b = inf{b,}. Now 
show that NJ, = [a, b]. 


Exercises 2.5. page 79 
4. If x € P with x = .ajaeg---, dn € {0,2}, set b, = 4 An. Consider the function 
x- .b1b2 ereren. 


Chapter 3 


Exercises 3.1. page 87 

1. (a) Let a, = (8n+5)/(2n+7). Then |an — 3| = 4/(4n+7) < 1/n. Given € > 0, 
choose no € N such that n. > 1/e. Then for all n > no, |an — 3| < e. Therefore 
liman = 3. (c) Set an = (n? +1)/2n?. Then |an — 5| = 342 < gy. Given € > 0, 
choose no € N such that no > 1/2. Then for all n > no, |an — 5| < e. Thus 
liman = 4. (f) First show that /n+1— Jn = 1/(/n +14 Vn) < 1/(2Vn). 
Now given € > 0 choose no such that 1/(2\/n) < € for alln > no. 2. (a) If n is 
even then n(1 + (—1)”) = 2n. Thus the sequence is unbounded and diverges in R. 
(c) When n is even, i.e., n = 2k, then sin 3 = sinka = 0. On the other hand, when 


2 
nis odd, ie. n = 2k+1, then sin 22 = sin(2k+1)% = (—1)*. Thus sin 44 assumes the 
values —1,0, and 1 for infinitely many values of n. Therefore the sequence diverges. 
A. (a) Write b = 1+ a where a > 0. By Example 1.3.2(b), 6” > 1+ na. Now use 
the previous exercise. 5. First show that |a2 — a?| < (|an|+ |a|)|an — a]. Now use 
the fact that since {a,} converges, there exists a positive constant M such that 
|an| < M for alln € N. 6. Consider a = 0 and a > 0 separately. For a > 0, 
Van — Ja = (an — a)/(\/an + Va). 8. Take « = a/2. Then for this ¢, there exists 
no € N such that |an — al < a/2 for all n > no. From this it now follows that 
an > a/2 for alln > no. 


Exercises 3.2. page 93 

5. (b) If p > 1, let an = x%/p—1. Apply the inequality of Example 1.3.2(b) to 

(l+an)”. 6. (a) 3/5. (ce) -1l. (e) 0. (g) a/2. 7. (a) converges to 1. 

(c) converges to 0. (e) converges to 2/3. 8. Use the fact that | cosa] < 1. 

10. (a) Suppose lim an41/an = L < 1. Choose € > 0 such that L +e < 1. For 

this « there exists no € N such that Qn41/An < L-+e for all n > no. From this 

one obtains that for n > mo, 0 < an < (L+6€)”"°an, = M(L +)", where 

M = an,/(L +6)". Since (L + €) < 1, by Theorem 3.2.6(e), lim (L + €)” = 0. 

n—oo 

The result now follows by Theorem 3.2.4. 11. (a) With a, = n?a",0 <a <1, 

L= lim wnt =a lim (1++)? =a. Thus since L = a < 1, the sequence converges. 
nm—oo n n—-oo 

12. Set an = (an —1)/(an +1) and solve for an 13. (b) Verify the result for n = 1. 

Assume the result holds for n = k. Forn =k+1, (1+a)@*t) = (14+ a)(1+ a)" 

which by the induction hypothesis 


049 (eEOQeHE Gt) 


j=0 j=0 
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k41 ; 

Using part (a) show that the above is equal to }> Ge ‘) a’. 14. (a) By con- 
j=0 

sidering the sequence {ax — a} show first that one can assume a = 0. 


Exercises 3.3. page 101 

1. Take In = [n,00). 2. (a) Set an = Vn? +1/n = /1 + 1/n?. Since 1/(n+1)? 
1/n? we have adn+4i < Gn and liman = 1. 4. Use mathematical induction to show 
that an > 1 for all n € N. From the inequality 2ab < a? + b?, a,b > 0, we have 
Qan < a2 +1or any = 2- 1/an < an. Therefore {an} is monotone decreasing. 
Finally, if a = liman, then a = lim Qn41 = lim (2 —1/an) = 2 —1/a. Therefore 


a= 1. 6. (a) Use induction to show that z, > a for all n. The inequality 
ab< (a? +b’), a,b > 0 should prove useful. Use the fact that rz, > /a to prove 
that {xn} is monotone decreasing. Consider %,41 — % and simplify. 8. (c) {an} 
is monotone increasing with a, < 3 for all n. If a = lima, then a? = 2a+3. Thus 
a= 3. (e) {an} is monotone decreasing with a, > 2 for all n and lima, = 2. 
10. (a) e? (c) e*/?. 11. To show that {s,,} is unbounded show that son > 1+. 
Hint: First show it for n = 1,2, and 3, then use mathematical induction to prove the 
result for alln €N. 13. Hint: For k > 2, & < KE: 7 = 4 -¢. 15. (a) Write 
a =1+0 with b > 0. Now use the binomial theorem to show that a”/n > cn for 
some positive constant c and n sufficiently large. (c) n4 cy" >n-—+>(n-1). 
16. (d) The sequence is not monotone: If x, = n + (—1)"Vn, then teny1 < Len. 
21. This problem is somewhat tricky. It is not sufficient to just choose a monotone 
increasing sequence in the set; one also has to guarantee that the sequence converges 
to the least upper bound of the set. Let E be a non-empty subset of R that is bounded 
above. Let U/ denote the set of upper bounds of E. Since E 4 0, we can choose an 
element 11 € E. Also, since EF’ is bounded above, U # 0. Choose 61 € U. Let 
a,= 4 (a1 + 81), and consider the two intervals [x1, a1] and (a1, 1]. Since x1 € E, 
one, or both of these intervals have non-empty intersection with EL. If (a1, AiJNE 4 9, 
choose x2 € FE such that ai < x2 < by. In this case set Bo = 81. If (a1, JN E=9, 
choose x2 € FE such that 71 < v2 < ai, and set G2 = ay. In this case Bo € U. 
Proceeding inductively construct two monotone sequences {xn} and {8,} such that 
(a) {an} C EF with an < xn4i for all n, (b) {6,2} CU with Br > Bri for all n, 
and (c) 0 < Bn —an < 2 tT (by — 1). Assuming that every bounded monotone 
sequence converges, let 3 = lim B,. By (c) we also have 6 = lim ny. It only remains 
to be shown that 8 =sup FE. 22. Suppose A = {xy : n € N} is a countable subset 
of [0, 1]. To show that A & [0,1] proceed as follows: At least one of the three closed 
intervals [0, 3], (3, 3 aE , 1] does not contain x. Call it [;. Divide J; into three closed 


393 
intervals of length 1 / 3°. At least one of these, say Iz, does not contain x2. 


Exercises 3.4. page 106 

3. (a) {-1,0,1}. (c) {1}. (e) {1,-3}. 4. (a) e?. 10. For convenience we 
take n = 2. Let {pn} be a bounded sequence in R* where for each n, Pn = (Gn, bn). 
But then the sequences {an} and {bn} are also bounded. Since {an} is bounded, by 
the Bolzano-Weierstrass theorem there exists a subsequence {an, } that converges, 
to say a. Since the sequence {bn, } is also bounded, it has a convergent subsequence, 
say {dni} that converges to say b. But then the subsequence {Pn,, } converges to 
(a, b). 
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Exercises 3.5. page 112 


1. (a) {—00, oof. (c) {-1,1}. (f) {-4, 2}. 3.0,1. 6. (a) Let a = lima, and 
y = lim(an + bn). Since the sequences are all bounded, a,7 € R. Let € > 0 be given. 
Then by Theorems 3.5.3 and 3.5.4 there exists no € N such that an > a—€/2 for all 
n > no and (an+bn) < y+e/2 for all n > no. Therefore by < y+e/2—an < y-ate. 
From this it now follows that lim bn < y—a-+e. Since € > 0 was arbitrary, we have 
limb, < y— a; ie., lima, + limb, < lim(an + bn). The other inequality is proved 
similarly. 8. {4,1}. Hint: Consider the subsequences {2m} and {s2m41}. 

10. By Theorem 3.5.7, there exists a subsequence {an, } of {an} such that an, — a. 
Since {b,} converges to b, Gn,bn, — ab. Therefore ab is a subsequential limit of 
{anbn}. Thus Tim anbn < ab. The reverse inequality follows similarly. The fact that 
b £0 is crucial. 


Exercises 3.6. page 118 


2. (a) The sequence {(n + 1)/n} converges and thus is Cauchy. (d) The sequence 
converges to zero and thus is Cauchy. 4. (a) Consider san — sn. 10. For n > 3, 
|Qn41—an| < tan —dn-1|. Therefore the sequence {an} is contractive. If a = liman, 
then 0 < a < 1 and is a solution of a? + 2a—1=0. 18. (b) Since (@n41 — an) = 
(b—1)(an — Gn—1), by induction (an41 — an) = (b— 1)"~1 (az — a1). Therefore, 


m not 1—(b-1)" 
An¢1 — G1 = Do (x41 — Gk) = (a2 — a1) D9 (b— 1)" = (a2 — a1) . 
k=1 k=0 2—5b 


Letting n + co gives a= ai + sp (a2 — a). 


Exercises 3.7. page 123 


n n 
1. Let sn = SS pz: Since & < FQ —-G KD 2, forn>2,5,<14+>D (a -#)= 
k=l k=2 


2- - <2: Therefore {sn} is bounded above and hence converges by Theorem 3.7.6. 
5. Use the inequality ab < $(a? +b’), a,b>0. 


Chapter 4 


Exercises 4.1. page 142 

1. (a) If f(z) = 2a — 7, L = —3, then |f(a) — L| = 2|x — 2|. Given € > 0 take 
6 = €/2. Then for all x with |x — 2| < 6, |f(x) — L| = 2|a-2| << 26=c. (c) If 
f(x) = a/(1+2), then |f(x)—$|= way < 4|a—1| for all x > 0. Hence given € > 0, 
choose 6 = min{2e, 1}. With this choice of 6, x > 0 and thus | f(a) — $| < $6 <e. 
(e) Let f(a) = (@? + 1)/(a + 1). Since «? +1 = (# + 1)(x? — x +1), we have 
f(x) = 2? —a+4+1 for x # —1. Therefore | f(a) —3| = |x+1||x—2|. But for -2 < « <0 
we have |x — 2| < 4. Therefore for all such x we have | f(x) — 3| < 4] — (—1)|. Given 
€ >0 take 6 = min{$,1}. Then for |2 — (—1)| < 6 we have |f(x) — 3| <e. 

2. (c) We first note that 2? — p? = (# — p)(x? + ap +p’). For |x — p| < 1 we have 
|z| < |p| +1. Therefore |x* — p?| < (3|p|? + 3|p| + 1)|2 — pl. Hence given « > 0 
choose 6 so that 0 < 6 < min{1,¢/(3|p|? + 3|p| + 1). Then for |x — p| < 6 we 
have |x? — p®| < «. (e) Note that for x > 0, /x — /p = (x — p)/(Vz + vB). 
Therefore |,/z — \/p| < |x — p|/,/p. Given € > 0 choose 6 so that 0 < 6 < \/pe. 
Then if |x — p| < 6 we have > 0 and |\/z— /p| <e. 3. (a) The limit does not 
exist. For x > 0, x/|x| = 1, whereas for x < 0, x/|z| = —1.  (c) The limit does 
not exist. Consider the sequence {1/n7} which has limit 0 as n > 00. = (e) Since 
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(a + 1)? —1 = a + 22 we have that for « #0, [(x + 1)? — 1]/a = + 2. Thus the 
limit as « + 0 exists and equals 2. 4. lim, f(x) = -3. 5. (a) By Figure 4.5, 
a 


for 0 < t < 7/2, sint = length of PQ < length of arc PR=t. 7. (a) Use the 
inequality || f(a)| —|L|| <|f(@)-—L]|. (ec) Use induction on n and Theorem 4.1.6. 


8. (a) 0. (c) Jt (e) ¢- (g) 2. Note: sin2z/x = 2(sin2z/2zr). 9. Let L = 
lim f(x). By hypothesis L > 0. Take « = $L and use the definition of limit. 
rp 


12. Since g is bounded on E£, there exists a positive constant M such that |g(x)| <M 
for all « € E. Thus |f(x)g(x)| < M|f(x)| for all 2 € E. Now use the fact that 
lim f(z) = 0. 14. (a) By Theorem 4.1.6 (a), lim g(x) = lim(f(x) + g(x)) -— 
2p “2p 2p 


lim f(x), both of which are assumed to exist. 16. Suppose lim f(x) = L. Let 
Lp 2 0o 


€ > 0 be given. By definition there exists M > 0 such that |f(x) — L| < e for 
all x € (a,co) with « > M. Let 6 = 1/M. Then for all t € (0,1/a) with t < 6, 
1/t € (a,co) and 1/t > M. Therefore |g(t) — L| = |f(4) — L| < €. The proof that 
lim g(t) = L implies Jim f(x) = Lis similar. 17. (a) 3/2. (c) 2. (e) 1/2. 
(g) Limit does not exist. For all 2 > 1/3, cos+ > 1/2. Thus xcos+ > x/2 and 
Z COS + + 00 as L > 00. 


Exercises 4.2. page 155 
1. (c) Since 1 — cosa = 2sin?(a/2), for « # 0, g(x) = 2 sin?(x/2). Now use the 


fact that |sint| < |¢|.(d) Since lim,_,2 k(x) does not exist, k is not continuous 
at % = 2. 2. (b) The function f is not continuous at 1. Consider f (pn) where 
{pn} is a sequence of irrational numbers with pn > 1. 4. If p> 0, |f(x) — f(p)| = 
|. /2—./p| = |z—p|/(/e+ bd) < ale p|. Let € > 0 be given. Set 6 = min{p, ,/pe}. 
Then |x — p| < 6 implies that | f(x) — f(p)| < e. Therefore f is continuous at p. If 
p = 0, set 6 = €?. Alternately use Theorem 4.1.3 and Exercise 6 of Section 3.1. 
5. (b) Verify that limz_.o f(x) = 0. Hence if we set f(0) = 0, the function f is 
continuous on [0,1]. 6. (a) See Exercise 7(a) of Section 4.1. 7. Use Theorem 
4.2.4. and the fact that x” is continuous on R for alln EN. 9. (a) R\{—2,0, 2}. 
(c) R. 8. (a) Use an identity for cos x — cosy and Exercise 5(a) of Section 4.1. 
12 (a) With the metric dz, verify that 

do(f (x1, 41), f(w2, y2)) = V2[(@1 — 22) + (yr — yr)? < 2 (a1 — 22)? + (yr — y2)? = 
2d((x1, yi), (x2, y2)). 

Hence given € > 0, take 6 < $€. 14. (a) Hint: Use the fact that max{ f(x), g()} = 
(f(x) + g(x) + |f(x) — g(x)|). 16. If p(x) is a polynomial of odd degree, show 
that limz-o0 p(x)/p(—x) = —1. Hence there exists an r > 0 such that p(r) and 
p(—r) are of opposite sign. Now apply the Intermediate Value Theorem to p(x) on 
[—r,r]. 17. Consider g(x) = f(x)— f(x—1), « € [0,1]. 19. Let p € E bea limit 
point of F’. Use Theorem 3.1.4 and continuity of f to show that pe F. 22. Take 
€ = 1. Then for this choice of € there exists a 6 > 0 such that | f(x) — f(p)| < 1 for all 
x € Ns(p)NE. Show that this implies that | f(«)| < (|f(p)|+1) for all x € Ns(p)NE. 
25. First show that f(A) is closed as follows. Let q be a limit point of f(A). Then 
there exists a sequence {pn} in K such that f(pn) + g. Now use Theorem 3.4.5 and 
continuity of f to prove that q € f(A). Now assume f(K) is not bounded. Then 
there exists a sequence {pn} in K such that |f(pn)| 4 oo. Obtain a contradiction as 
above. 27. (a) Suppose x € (go f)~'(V). Then g(f(x)) € V. Hence by definition 
f(z) € g '(V). But then z € f~'(g~')(V). The reverse containment follows likewise. 
29. By hypothesis, for each x € K there exists €¢g > 0 and M,; > 0 such that 
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|f(y)| < Mz for all y € Ne, (a) K. The collection {N-, («)}2ex is an open cover of 
kK. Now use compactness of K to show that there exists a positive constant M such 
that |f(y)| < M for ally € K. 

Exercises 4.3. page 161 


2. (a) Suppose f(a) = 2? is uniformly continuous on [0, 00). Then with ¢ = 1, there 
exists a 6 > 0 such that |f(a) — f(y)| <1 for all x,y € [0, 00) satisfying |x — yl <6: 


Set tn =n and yr, =n+ =, If no EN is such that nod > 1, then |yn —x#n| = = <6 

for all n > no. But |f(yn) — toes a 2 + <5 > 2 for all n. This is a contradiction! 

(c) Take pn = CESIES and qn = . Then |h(pn)| = 1 and h(qn) = 0 for all 
2 


n. But {pn} and {gn} both converge te 0. Hence given any 6 > 0 there exists 
an integer n. such that |pn — qn| < 6 for all n > no and |h(pn) — h(qn)| = 1. 


Hence fh is not uniformly continuous on (0,00). 3. (a) For all x,y € [0,00), 
lf(z)-f@| =| - Hl = atte < |x — y|. Thus ae € > 0, the choice 
6 =ewill work. (c) We first note that |h(x)—h(y)| = tee ly—a|= ie =a 


GAG 

But for |y—a| < 1, |y| < |a| +1. As a consequence (|a| + |yl)/(a? +1) < 2. 
(Verify!) Therefore |h(x) — h(y)| < 2|y — x]. Hence given € > 0, choose 6 so that 
0 <6 < min{l,¢/2}.  (f) Set g(x) = sina/x, x € (0,1] and g(0) = 1. Then g 
is continuous on [0,1], and thus by Theorem 4.3.4 uniformly continuous on [0, 1]. 
From this it now follows that f is uniformly continuous on (0,1). 4. (a) Show 
that | f(x) — f(y)| =| s| < 4|2 — y| for all x, y € [a,00),a >0. (ec) Using a 
trigonometric identity for sin A — sin B we obtain 

ain (Z — *)| . Now us- 

2 xy 


“oA (2 +) cos (+++) <2 
2\nu oy 2\nu oy 

ing the inequality | sin h| < |h| we have 
2 sin 5 (<*) < i < Sly x| for all x, y € [a, co). 
B. (a) [VE — Val = le — yl/(VE+ VB) < gle — yl provided 2,y € [a,00). 
(c) Assume that it does and obtain a contradiction. 7. (b) Suppose |f| and |g| 
are bounded by M, and Mg respectively. Then 
LF(a)g(x) — Flyo(w)| < LF @lae) — 9(y)| + lo@ILF(@) — FO) < Malg(e) — g(y)I + 
Mal f(a) — f()l 
Now use the uniform continuity of f and g. 10. Suppose f is not bounded. Then 
there exists a sequence {xn} in E such that |f(an)| — oo. Since E is bounded, 
{zn} has a convergent subsequence {x,,} in R. Thus {xn,} is Cauchy. Since f is 
uniformly continuous, { f(2n,)} is Cauchy. But then by Theorem 3.6.2 the sequence 
{f(#n,)} is bounded, which is a contradiction. 12. (a) By taking « = 1 show that 
there exists ro such that |f(x)| < |£|+1 for all x € [ro, 00). Now use the continuity 
of f on [a,r.] to conclude that f is bounded on [a,oo). 18. (a) Let x; € E be 
arbitrary. For n > 1 set tn41 = f(an). Show that the sequence {x} is contractive. 


: _ 1 
sin sin — 
x 


Exercises 4.4. page 175 

2. (b) Bue f(x) = nk. f(x) =0. (d) For 0 < |a| < 1, [x? — 1] = —1, Hence 
both the right and left limit at 0 exist and are equal to —1. (f) i f(z) =1 
Hint: For 4 < « < 1, [4] =n. 4. Use the fact that [2] is bounded near 


n+1 — n’ la 


to =2. 6.(b)b=—-10. 7. (b) Forne N set tp =n and yx =n+ 4, and 
show that |f(an) — f(yn)| = sin2. 10. (a) Define F on [a,b] by F(x) = f(z) 
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for x € (a,b] and F(a) = f(a+), which is assumed to exist. Then F is continuous 
on [a,b], and thus uniformly continuous by Theorem 4.3.4. Hence f is uniformly 
continuous on (a, 6]. 12. If nm € N, g(a) = 2” is continuous and strictly increasing 
on (0,00) with Range g = (0,00). Therefore by Theorem 4.4.12, its inverse function 
g ‘() = «'/” is also continuous on (0,00). From this it now follows that f(a) is 
continuous on (0,00). 14. (a) Suppose first that U = (a,b) C I. Then since f is 
strictly increasing and continuous on I, f((a,b)) = (f(a), f(b)), which is open. For 
an arbitrary open set U C I, write U = U,, In, where {In} is a finite or countable 
collection of open intervals and use Theorems 1.7.14 and 2.2.9. 16. (b) f is strictly 
increasing on [0, 3) and strictly decreasing on [4,1], and thus one-to-one on each of 
the intervals. (c) f([0,5)) = [0,1) and f([5, 1]) = [1,2]. Therefore f([0,1]) = [0, 2]. 
(d) For y € [0,1], f~*(y) = 4y, and for y € [1,2], f-'(y) = $(3— y). Therefore 
f~*(1-) = $ and f~*(1+) = 1. Thus f~* is not continuous at yo = 1. 


Chapter 5 

Exercises 5.1. page 190 

1. (a) For f(x) = 2°, 

Hey a A a Ee os ee lim (32? + 32h + h?) = 32”. 


h0 h h0 


(c) For h(x rte aD, 


—1 1 
! _ 4: =e as eo 
h(a) Hate h ian ay = x 
© f(a +h) — f(z) i 
F — 1 = : 
(e) For fl) = 2, 24-1, d aes 
dl 1 


1 : 
Thee) eae hady ee: 
2. If n € N, by the binomial theorem 
(a+h)"-2? => (7) hka?—*® = nha” +h > (;) a 

k=1 k=2 
Dividing by h and taking the limit as h — 0 proves the result for n € N. Ifn € Z 
is negative, write x” = 1/x”,m € be and use Theorem 5.1.5(c). 3. (a) Since 
cosx = sin(a + 5), by the chain rule $ cosx = cos(x + 5) = —sinw. Alternately 
use the achninon of the derivative. 5. * (a) Yes. (c) No. (e) Yes. 
7. (a) f’(x) exists for all xz € R\ Z. For x € (k,k4+1),k EZ, f(x) = 2[2] = kz. 
Thus f’(z) = k. (c) The function h is differentiable at all x where sinz # 0. 
For x € (2km,(2k + 1)m), k € Z, h'(x) = cosa. For x € ((2k — 1)7, 2k), k € Z, 


h'(z) =—cosx. 9. (b) For x £0, g’(x) = 2xsin 4 — cos 4. Since lim, cos = does 
oe 
not exist, md ( se does not exist. 10. (a) 2a+b = 6. ee a= 4,b = -2. 
as 
Justify why b= —2. 12. (a) ie =2/(2e+1). (c) h'(z) \ ice. 


14. (b) fi. (0) = “im pne-) sin ;, OR exists and equals 0 if and an : (b—1) > 0; 
ie, b>1. 15. ‘(b). No. Sonics f(x) = |a| at « =0. 

Exercises 5.2. page 203 

3. (a) Increasing on R. (c) Decreasing on (—oo,0) and increasing on (0,00), 


with an absolute minimum at x =0. (e) Increasing on (—oo, 2) U (2, 00), decreas- 
ing on (0,2). The function has a local minimum at « = 2. 5. (a) Let f(x) = 
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(1+ a)2,2 > —1. By the mean value theorem f(x) — f(0) = f’(¢) where ¢ is be- 
tween 0 and x. If x > 0, then f’(¢) < 3. On the other hand, if « < 0 and z <¢ <0, 
then f’(¢) > 4. But then f’(¢) < $a. (c) Take f(x) = x°,0 < a < 1. Then 
f(a) — f(a) = f'(¢)(@ — a) where a < ¢ < x. But then f’(¢) < aa®™?. 

6. (a) Show that the function f(2) = «'/" — (a—1)'/" is decreasing on the interval 
1<a<a/b. (b) Set f(a) = ax — 2%, x > 0. Prove that f(x) > f(1) to obtain 
x* <ax+(1—a), x > 0. Now take x =a/b. 7. (a) If f’”(c) > 0, then there exists 
a 6 > 0 such that f’(x)/(x —c) > 0 for all x, |x — c| < 6. Therefore f’(x) < 0 on 
(c — 6,c) and f’(x) > 0 on (c,c +6). Thus f has a local minimum at c. 

8. Show that f’(x) = 0 for all x € (a,b). 9. Since P(2) = 0 we can assume that 
P(x) = a(x — 2)? + b(x — 2). Now use the fact that P must satisfy P(1) = 1 and 
P’(1) =2 to determine aandb. 10.a=—2,b=2,c=1. 12. (a) See Example 
4.1.10 (d).  (b) By the result of (a), f’(x) < 0 for all a € (0,3). 14. (a) Let 
tn + c. Since f’(c) exists, Jim (f (tn) — f(c))/(tr —¢) = f'(c). Now apply the mean 


value theorem. 17. Since f(a) = lim, (f(«) — f(a))/(x — a) > 0, there exists a 
@r—a 


6 > 0 such that (f(x) — f(a))/(@— a) > 0 for allz,a<a<at6. 

19. Hint: Consider f’(x). 20. (b) Check the values of f’(x) at pn =1/(n7),n EN. 
24. (a) For fixed a > 0 consider f(x) = L(ax),x € (0,00). (c) By (a) and (b), 
L(b") = nL(b) for all n € Z and b € (0,00). But then L(b) = L((b1/")") = nL(b!/”). 
From this it now follows the L(b") = rL(b) for all r € Q. Now use the continuity 
of L to prove that L(b”) = xL(b) for all « € R where 6” = sup{b" : re Qr< 
x}. 25. (b) Since tan(arctanz) = x, by Theorem 5.2.14 and the chain rule, 
# tan(arctanz) = (sec”(arctanx))(“ arctanz) = 1. The result now follows from 
the identity sec?(arctan x) = 1+ 2”. To prove this, consider the right triangle with 


sides of length 1, |x|, 1+ 2? respectively. 


Exercises 5.3. page 212 
a, £2) _ F(a) ~ fle) ;9(2) ~ 926) 


. Now use Theorem 4.1.6(c) and the definition 
of the derivative. 4. Use the fact that since lim, f(a) exists, f(x) is bounded on 
ra 


5 a 4 
(a,a+6) for some 6 ‘ 0. 6. (a) lim —— = = lim a = = t (c) By 
nz 


VHopital’s rule, lim —— = lim = 0.  (e) Make the substitution x = 1/t. 


zZ—-oo roo 
(g) 0. Use repeated applications of |’Hospitals rule until the exponent of In z is less 


than or equal to zero. (i) 0. Use l’Hospitals rule twice on (sinx—2)/(asinx), « £0. 
9. (a) f"(0)=0. (b) f"(0) =—2. 

Exercises 5.4. page 219 

1. Let ci > 0 be arbitrary. By Newton’s method ¢n41 = (23 + a) /3c2,. 

2. (a) f(0) = 1 and f(1) = —1. Therefore f has a zero on the interval [0, 1]. 
With c: = 0.5, co = 0.33333333, f(c2) = 037037037, cs = 0.34722222, f(cs) = 
0.000195587, c4 = .34729635, f(c1) = 0.000000015. 


Chapter 6 
Exercises 6.1. page 238 


1.(a) Since f is increasing on [—1, 0] and decreasing on [0, 2], m1 = mz = 0, m3 = —3 
and M; = Mz = 1, M3 = 0. Since Az; = 1, L(P, f) = —3 and U(P, f) = 2. 
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=f ieee ty 
aeAe) 2) 2, 1<a2<2. 
and let k € {1,...,n} be such that rp-1 < 1 < ap. Then L(P, f) = 4 — 32% and 
Uu(P, f) = 4-3a,_1. ThusU(P, f)—L(P, f) = 3(@x.—x~~-1). By Theorem 6.1.7 it now 
follows that f is Riemann integrable on [0,2]. Also, since r,_1 <1< ap, L(P, f) < 
1<U(P, f) for any partition P. Hence i f = 1. Alternatively, consider the parti- 
tion P = {0,c, 1,2} where 0 < c < 1 is arbitrary. For this partition, £(P, f) = 1 and 
Uu(P, f) =4— 3c. The results now follow as above. 3. (a) If P = {%o,21,...,2n} 
is a partition of [a,b], then inf{ f(t) : t € [w:_-1, vi]} = sup{ f(t) : t € [ai_1, xi]} =e. 
Therefore L(P, f) =U(P, f) = d> c(wi—azi-1) =c(b—-a). 4. (a) Since f(x) = [32] 

i=l 

is monotone increasing on [0, 1], f is Riemann integrable on [0, 1]. For n > 4 consider 


the partition P, = {0,4 — +, 3, 3 +, z, 1— 4,1}. For this partition L(Pn, f) =1 


Let P = {x0,21,...,%n} be any partition of (0, 2] 


1 
and U(Pn, f) = 1+ 3. From this it now follows that [([3a] dx = 1. 


0 
(c) Since f is increasing on [0,1] it is Riemann integrable. Take P, = 


ike a 1 3 12 
seogil Th mf) = Fl = i 1 
(.2,2,--01} Then UPaf) = E(se+1)> = Sei+ ly 
_ + 1. Therefore i (38a + 1)dx = Jim 5 (1 +) F1l= a 6. Let 


P = {x0,%1,...,2n} bea partite of [a,b]. Since f(x) < g(x) for all x € [a,)], 
sup{f(t) : t € [xi-1,vi]} < sup{g(t) : t © [wi-i1,a:]} for all i = 1,...,n. Asa 
consequence U(P, f) < U(P,g) for all partitions P of [a,b]. Taking the infimum 


P b 
over P gives ff < fg. The result now follows from the fact that f, g € R[a, bj. 


1 1 
8. ff = Jf =}. 10. Since a > 0, f is increasing on [a,b]. Thus if 
0 0 


= {0,01 .. .+; In} is a partition of [a, d], m = = x?_, and M; = 2?. Therefore 


— = a x7,Ac; and U(P,f) = 3 x?Ax;. Now show that 27_,Az; 
i=l i=l 


IA 


4(a} — 231) < x7 Aaj. From this it will now follow that L(P, f) < 5 —a*) 


lA 


b 

U(P, f). Since f is continuous, f € Ra, b] with ff = 50 —a®). 12. (a) With 

Pe ={ 22 8=0,1,2.5,0} and fe). = 

U(Pr, f) = 2 (=) = = > k. By Exercise 1(a), Section 1.3, 3 k= 5n(n+1). 
k=1 k=1 


1 
Therefore fxdx = lim n(n +1)/(2n?) = 1/2. (c) Take P, = {0,+,2,..., 1}. 
0 n—-co 
Then : 7 
U(Pn, f) = >> (=) ees ye = a [4n(n4 yy = : +2] . Therefore, 
i=1 


n nt nt 


1 
f«'dx = lim U(Pr,f) = 1/4. 18. Use Theorem 6.1.7. 14. (a) Let P, = 
nm—-oco 


0 

{xo,21,22,...,Xn} be a partition of [a,b], and for each i = 1,2,...,n, let M; and 
M; denote the supremum of f and |f| respectively on [xi:-1, 2]. Likewise, let mi 
and mj; denote the infimum of f and |f| respectively on the same intervals. Use the 
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inequality ||f(s) — |f()|| < |f(s) — f()| to prove that Mj — mj < M; — m; from 
which the result follows. 15. (a) Since f is bounded on [a,b], | f(x)| < M for all 
x € [a,b]. Let P = {xo, 71, ...,&n} be any partition of [a, b]. For each i let M;(f*) and 
mi(f?) denote the supremum and infimum of f? respectively over [xi-1, xi], with an 
analogous definition for Mi(f) and m;(f). Let € > 0 be given. Then for each 7 there 
exists s;, t; € [wi_1, 2] such that Mi(f?) < f?(s;) + $€ and mi(f?) > f? (ti) — $e. 
Therefore 

0 < Mi(f?) — mi(f?) < f?(si) — f?(4) + € < If (si) + FDIS (si) — F(t) + < 
2M[M,(f) — mi(f)] + € 

Since this holds for any « > 0, Mi(f?) — mi(f?) < 2M[Mi(f) — mi(f)]. Now use 
Theorem 6.1.7. 16. Assume that f is continuous on [a,b] except perhaps at a or 
b, or both. Since f is bounded there exists M > 0 such that |f(«)| < M for all 
x € [a,b]. Let € > 0 be given. Choose y1, yo, a < yr < y2 < bso that yi —a < «/8M 
and b— yo < «/8M. Then 

fup{ f(t) :t € [a vil} — inf f(E) :t € [a, an} (en — a) < 2M(y. — a) < de 
Similarly for the interval [y2, b]. Since f is continuous on [y1, y2] there exists a par- 
tition P of [y1, y2] such that U(P, f) — L(P, f) < se. Let P* = PU {a, b}. Then P* 
is a partition of [a,b], and by the above U(P*, f) — L(P*, f) < e. Thus by Theorem 
6.1.7, f € Ria, b]. Suppose f is continuous on [a,b] except at a finite number of 
points c1,C2,...,Cn with a < ca. < co < +--+ < cm < b. Apply the above to each of 
the intervals [a, ci], [c1, ca], ..., [cn, b] to obtain a partition of [a, b] for which Theorem 
6.1.7 holds. 


Exercises 6.2. page 247 


2. (a) Take t; = $(v7 + 2izi-1 +271). 3. (a) If cr 4a, set co =a. Similarly, set 
Cn41 = bifcn # b. First prove that f € R[ci-1, ci], 7 = 1, 2,...,n+1 with oe. f=0. 
Now use Theorem 6.2.3. (b) Seth = f—g. 5. Since f is bounded, |f(x)| <M 
for all x € [a,b] for some M > 0. Use equations (7), (8), and the fact that f € R{c, b] 


for every c € (a,b) to prove that 


b b e c 
0<ff-JSf=ff-Jff <2M(c—a). 


n 1 
Use this to show that f € Ria, b]. 7. (a) lim = De eee Ee z 
noo NP p=y 0 3 


n 1 
(c) Jim u 72 a a= J i = 3 dz = 7 8. For each fixed c, 0 < c < 1, the series 


defining f becomes a finite sum on [0,c]. Evaluate So f and use Exercise 5. 


Exercises 6.3. page 255 
2. Since f is bounded, |f(x)| < M for all x € [a,b]. If x,y € [a,b] with x < y, then 


|F(y) — F(2)| = js < fifl< Miy—al. 


Thus F' satisfies a Lipschitz condition on [a,b] and hence is uniformly continuous. 
3. (b) F(x) = 2 for0 <2 < 4; F(t) = 3-22 for} <x<1. (d) F(z) =0 
for 0 <a < 4; F(a) = }(@”— 4) fori <a< 2; F(t) = 2? — % for? <a <i. 
6. (b) F’(x) =cosx?.  (d) F’(x) = 2xf(x?). 7. By the chain rule, £L(4) = 
—1 = +[-L(a)]. Therefore L(+) = —L(x) + C for some constant C. Taking z = 1 
shows that C=0. 10. Let m and M denote the minimum and maximum of f on 
[a, b] respectively. Since g(x) > 0 for all x, mg(x) < f(x)g(x) < Mag(a). If fg > 0, 
then from the previous inequality one obtains 
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b b 
m<Jffo/fgo<M. 


Now apply the intermediate value theorem to f. If fg = 0, use Theorem 6.2.2 to 


prove that f : fg = 0 and thus the conclusion holds for any c € [a,b]. 12. (a) With 
In 2 


2 
y(x) = Ina, by Theorem 6.3.8 f “*dx« = f ada = }(In2)?.  (b) Use integration 


1 0 
by parts. (e) 2 In2—1. Use Exercise 9 with p(x) = Vx and f(t) = t/(1 +t). 
13. (b) With the given change of variable, dr = asec” tdt and Va? + x? = asect. 


. z 
Therefore / = i sect dt. To evaluate this last integral first establish 
0 0 


1 
————_ dz 
Va? + a? 

sint cost 
that sect = —— 

cos 1+sint 
For the reverse inequality, given €, 0 < « < M, using continuity of f show that there 
exists an interval I C [a,b] such that |f(x)| > M — « for all x € J. Using this show 


b 1/n 
14. That (J \f(a) "ax < M is straight forward. 


b 1/n 
that (J \f(a)!"ar) > (M — )é(1)/". Explain why the result now follows. 


c+th 


15. First show that Fi.(c) = im x J f(x) dz. Since f is monotone increasing 
0+ 


f (ct) exists. Thus given € > 0, there exists 6 > 0 such that f(ct) < f(x) < f(ct)+e 
for all x,c < « < c+. Explain how the conclusion now follows. 


Exercises 6.4 page 263 

1. (a) Since 0 < p< 1, fo x Pda = lim { a dx = lim > [1-c'?] = <b. 
cot © ce3o+ ~?P Pp 

Note: If p < 0, then x~” is continuous on [0,1], and if p > 1 then the improper in- 

tegral diverges. (d) Converges, with ie tInzdx=—}. (f) In this problem the 


integrand is undefined at « = 1. For0<c< 1, Pena Faedtz = 2 In(cos $c). Since 


aim, In(cos $c) does not exist, the improper iStearal diverges. 2. (a) Converges, 


with [>°e "da = lim fer “de = lim1—e © = 1. (c) The improper inte- 


C70 g coo 
gral converges with lim {fa dx = lim +, [1 coe = 4. (e) Diverges. 
coo coo P p Sa 


Cc 


tne” 


ace. he exist. 3. (a) For p > —1, the improper integral converges for all g € R, 
and for p < —1, the improper integral diverges for all q € R. When p = —-1, 
the improper integral converges for all q < —1, and diverges for allg > —-1. 4. 
Since lim,_,9+ f- f(x)dx = sin1 the improper integral converges. To show that the 


dx = In(Inc) — In(In2), which diverges to oo as c > oo. 


= 4 In(c? + 1). The improper integral diverges since jim, In(c? + 1) 


1 
improper integral of |f| diverges, first show that |f(x)| > — — 2a” on each of the 
x 


intervals . Use the above to find a partition Py such that 


Tar )x? Gao 
L(Pn,|f\) = C x 1/k, for some positive constant C' independent of N. From this 
k=1 


you can conclude that the improper integral of |f| diverges. 5. Hint: Use the fact 
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; 1 1 
that 0 < | f(«)| — f(w) < 2\f(@)|. 7. (a) f|SF| ae <fpde = — =. Thus 
T  C¢ 
fa F ‘ sin x 1 cose fcosz 
ae |f| <co. (b) By integration by parts, dx aor I = dx. 
By (a) and Exercise 5, lim [ sli dx exists. Also, lim ee <0 Therefore, 
coo 7. cco et 
. sing : : : 
lim dz exists. 9. (a) To show convergence of the improper integral con- 
c= 00 T 


sider the integrals of t”~'e~' over the two intervals (0, 1] and [1,00). If x > 1, then 
t”~te~* is continuous on [0,1], and thus the integral over [0,1] clearly exists. If 
0 <a <1, then since e~' < 1 for t € (0,1), 
1 1 1 1 
O< ft® te ‘dt < f t*~*dt = —(1—c*). Thus lim, [t®-te' dt < oo. Fort > 1, use 
c c x c30t 


lHospital’s rule to show that there exists a t, > 1 such that t*-! < e2° for all t Stee 
R 

Thus t®~te-* < e~*/? for all t > to, and as a consequence jim Lene ae < oO. 
R-+00 + 


Thus the improper integral defining I(x) converges for all x > 0. 


Exercises 6.5. page 278 


1. 2f(0). 3. (a) See Exercise 2, Section 6.3. 5. (a) 5 — 1. Use Theorem 6.5.10. 
(c) ee ee For « € (0, 3) [x] = I(w—1)4 Fo 2) + I(x —3). NOW tug topenle 


(12). (f) jee ])dx? = = fle —[a])3a?dx = faotart | aae+ | 6otae+ f 9a? dex 


etc. 8. (a) = 12. (a) As in the solution of Exercise 15(a) of Section 6.1, 
n=1 i 


if P = {xo, #1, ...,2n} is a partition of [a,b], Mi(f?) — mi(f?) < 2M[Mi(f) — mi(f)] 
where M > 0 is such that |f(x)| < M for all x € [a,b]. From this it now follows that 
0 < U(P, f?,a) — L(P, f?,a) < 2M[U(P, f,a) — L(P, f,a)]. Now apply Theorem 
6.5.5. 


Exercises 6.6. page 290 


2. (a) With n = 4,h = .25. Set a = .251,y = f(avi),i = 0,1,2,3,4. Then 
yo = 1.00000, y1 = 0.94118, y2 = 0.80000, y3 = 0.64000, ya = 0.50000. Therefore, 


Ta(f) = > [yo + 2y1 + 2y2 + 2y3 + ya] = 0.782795. 


25 
Sa(f) = > [yo + yn + 2y2 + 4ys + ya] = 0.785393. 
By computation f”"(t) = 2(3t? 1)/(1 + t?)3. Using the first derivative test, f(t) 
has a local maximum of 5 at t = 1. Therefore | f’’(t)| < 4 for all t € [0, 1]. Thus by 
equation (23) with n = 4, 


1 /1\ 1 
4 —Ti(f)| < 79 (5) — = 0.0026042. Since 7/4 = 0.7853982 (to seven dec- 


2) 4 
imal places), |t/4 — Ta(f)| = 0.0026032. 3. (b) By computation, f(x) = 


% 


3(4x? — 1)(1 + #”)~2. By the first derivative test the function f“) has a maxi- 
mum on [0,2] at « = V3/2. Thus |f“(x)| < 6/\/(1+ 2)? < 1. If we choose n 


(even) so that Rs f — Sn(f)| < 107°, then we will be guaranteed accuracy to 
four decimal places. By inequality (26) with M = 1, we need to choose n so that 
2° /180n* < 107°, or n* > 17,778. The value n = 12 will work. This value of n will 
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guarantee that E12(f) < 0.0000086. Compare your answer with the exact answer of 


V5 + 5 In(2+ V5). 
Exercises 6.7. page 296 


2. Hint: Consider f(%) = 1— y,(x), 0 < x < 1, and use Exercise 21(b) of Section 
6.1. 4. No. Consider g = xg on [0,1] and let f be the zero function. 


Chapter 7 


Exercises 7.1. page 313 


2. (a) Diverges. (c) Converges. (e) Diverges. (g) Converges by the ratio 
test. (i) Converges. (k) Diverges. First show that Vk > Ink for k > 4. Thus 
since > 1/k diverges, by the comparison test )>1/(Ink)? diverges. (m) Converges 
for p > 1; diverges for 0 <p <1. (0) Converges. Hint, rewrite }In(1 + 4) as 
zz n(1 + ;)* and use the comparison text. 3. (a) Converges to 1/(1 — sinp) for 
all p € R for which |sinp| < 1; that is, for all p A (2k+1)5,k € Z. 

A. (b) Since >> ax converges, lima, = 0. Thus there exists k, € N such that 0 < 
ax <1 for all k > ko. But then 0 < a? < a, for all k > ko, and Sa? converges 
by the comparison test. (d) Take ax =1/k?. (f) Converges. Use the inequality 
ab< 3(a” +b"), a,b>0. 5. The series diverges for all g < 1, p € R, and converges 
for allq > 1, p € R. If gq = 1, the series diverges for p < 1 and converges for p > 1. 
6. Suppose lim(an/bn) = L, where 0 < L < oo. Take € = iL. For this €, there exist 
ko € N such that sL < ar / be < 3L for all k > k,. The result now follows by the 
comparison test. 8. Since a, > 0 for all n, we have b; > a1/k for all k. Hence by 
the comparison test S>b, diverges. 11. For a simple example take a, = (—1)*. 
12. The proof uses the fact that lim (ty" = lm Vk" =1 forall ne Z. 


1 
13. The given series is the sum of the two series ——~ and ——~,, each 
2%, Ge—12 "2% Gee 


of which converges. 16. Let sn = a1+a2+---+@n and ty = a1+2ai+-::- +2¥ aon. 
By writing s, = a1 + (a2 +43) + (a4 + a5 +a6 +a7)+---, show that ifn < 2" then 
Sn <tr, andifn > pie then s,;, > ith. From these two inequalities it now follows that 
> ax < co if and only if > 2*a gx < oo. 18. (a) Diverges. If ax = 1/(kInk), then 
2* agk — 1/(kIn 2). 19. Use Example 5.2.7 to show that cx — cr+1 > 0 for all k. 
Thus {ci} is monotone decreasing. Use the definition of In k and the method of proof 
of the integral test to show that cy, > 0 for all k. 21. Write ax4i1/axy = 1—2%/k 
where rx = (q— p)(k/(q-+ k +1)). 


2 k 2 
22. (c) When p = 2, a, = (*7¢%55?) = IT (1-4) = (1- &)™. Now 


use the fact that lim (1 +h)" =e, 23. (a) Set sn = D> ax, and let s = limSn. 
=> 


k=1 
Consider the series }* b;, where b1 = (./s—\/s — 81) and for k > 2, by = (4/8 — 8K_1— 
VS — 8k). 


Exercises 7.2. page 320 


1. If {b,} is monotone increasing to b, consider 5>(b— bge)ar. 2. Take bey = 1/k 
h=1 


for k odd, and by = 1/k? for k even. 4. If Bn = >> coskt, then 


k=1 
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(sin $¢) Bn = 2 2a [sin(k + £)¢ — sin(k — 4)t] = 4[sin(n + 4)t — sin 43]. 
k 


5. (a) Converges. (c) Converges. (d) Diverges; im athe =1/eF#0. 


(f) Converges. (h) Converges for all t 4 2nz, n € Z. If t = 2nz, then the series 
converges for p > 1 and diverges for 0 < p< 1. 8. Use the partial summation 
formula to prove that 


n n-1 n 

> kar = nAn = a Ak where Ak = Se Ak. 
k=1 k=1 k=1 
Now use Exercise 14 of Section 3.2. 


Exercises 7.3. page 327 


2. Use the inequality |ab| < $(a’ +b’), a,b€R. 4. Use the hypothesis on |an| to 

show that sn = 77, |ax| < b1 — bnyi. 6. (a) Converges conditionally. 

(c) Converges absolutely for p > 1 and conditionally forO<p<1.  (e) Converges 
k 

absolutely for p > 1, and conditionally forO<p<1l. (g) Rewrite ay = a 

as ax = (1+ ¢) *. Since limz—soo ak = e~', the series )>(—1)*** ax diverges. (i) 

By the comparison test (with 57 1/k*) the series converges absolutely. 9. First 


k+1 


n—-1 


note that S3n = >> ( tj 
k=0 


1 
3h 3hq2 seas): Now show that $3, — oo as n > oo. 


11. By Theorem, 7.2.6 the series converges. To show that }>|sink|/k = oo, show 
that for any three consecutive integers, at least one satisfies | sin k| > s 


Exercises 7.4. page 333 
1. (a) |/{1/(nk)}||3 = 32 1/(Ink)?, which diverges (Exercise 5, Section 7.1). 
k=2 


co 


(c) |[{Ink/Wk}||3 = D> (nk)?/k which diverges by the Comparison test. 
k=2 

2. (a) |p| < 1. (c) p > 4. 3. Since {1/k} € @, the result follows by the 
Cauchy-Schwarz inequality. 9. If we interpret the vectors a and b as forming 
two sides of a triangle, with the third side given by b —a, then by the law of cosines 
\|b — all} = ||/bl]2 + |lall3 — 2\lall2||b|lzcos@. Now apply Exercise 8(e). 11. (b) 
Suppose {ax} € £1. Since limz +00 ax = 0 there exists ko € N such that |ax| <1 for 
all k > ko. But then |ax|? < |ax| for all k > ko. Hence {az} € &. 


Chapter 8 
Exercises 8.1. page 343 


2. (a) tim —™ -{° a=, 


noo 1+ nx 1, xz>0. 

0 +(2k-—1)2,keEN 
(c) lim (cosx)?" = 4” 7 ( Vo * 3. (a) By the root test the 

n—+00 1, w=+(2k—1)2,kEN. 
series converges for all |x| < 2; diverges for |x| > 2. (c) converges for all x > 0; 

1 1/n 2/n 

diverges forx <0. 5. (c) / fr= / ninde+ | (2n—n?x) dx = 1/2+1/2 = 
0 0 1 


/n 
1. 7. (a) fx =0, fr(0) =0 for alln EN. If « > 0, then 0 < f(x) < x/n, from 
which the result follows. (b) For each n € N, fn(a) has a maximum of e7! at 
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xz=n. 8. Use the fact that for VN, M EN, 

N M M N M co co co 

3 (Seam) = (Sram) eH (Soom) s PIPE do 
(a m=1 — m= n=1 = 


1 
The above inequalities hold since an,m > 0 for all n,m € N. Now first let M > ~, 
and then N —> oo, nee obtain 
S: (Sooum) = 35 (Seam) 
n=1 


The same argument (also proves the reverse inequality. 


Exercises 8.2. page 350 


2. (b) Suppose { f,} and {gn} converge uniformly to f and g respectively on E. Then 
| fn(@)9n(x) — f(x) 9(@)| < lgn (a) || fn (x) — f(x) +1 F(@)||9n (a) — g(@)|- By hypothesis 
lgn(x)| < N for alla € E,n EN. Also, since |fn(x)| < M for allx € E,n EN, 
|f(x)| < M for all x € E. Therefore 

| fn(@)gn(x) — f(a)g(a)| SN] fn(x) — f(@)| + Mlgn(x) — g(@)I- 

Now use the definition of uniform convergence of {f,} and {gn} to show that given 
e > 0, there exists no € N such that |fn(x)gn(x) — f(x)g(a)| < € for alla € E 
andn > no. 4. Find M, = max{fn(x) : « € [0,1]}, and show that Mn, — oo. 
5. (a) For x € (0, a], |fn(x)| < a”. If 0 < a < 1, then lim a” = 0. Thus given 
€ > 0 there exists no € N so that a” < e for all n > n.; that is |fn(x)| < ¢€ for 
all x € [0,a],n > no. Therefore {f,} converges uniformly to 0 on [0,a] whenever 


1 
a<1.  (b) No. Obtain a contradiction to Theorem 8.2.5. 8. (a) ease < re 


for all « € R. Since 3>1/k? < oo, the series > a converges uniformly by 
the Weierstrass M-test. (c) For x > 1, k?e~** < k?(1/e)*. Since 1/e < 1, the 


sin 2kx ee 1 <C il f ql 
(Qk + 1)3/2| = (2k + 13/2 = © R72 “FB 


< oo, the given series converges uniformly for all x € R by the 


series )> k?(1/e)* converges. 9. (a) | 


x €R. Since > BP 
Weierstrass M-test. (d) Since | sinh| < |h| we have | sin(x/k”)| < 2/k? for |x| < 2. 
Since p > 1, by the Weierstrass M-test the series converges uniformly and absolutely 
: a 1 1 

for |x| < 2.  (e) Hint: Let S;, (a) & (os (et Det2 10. (a) For 
x >a>0,1+k?a > ak?. Thus since 37 1/k? < 00, by the Weierstrass M-test the 
given series converges uniformly on [a, oo) for every a > 0. To show that it does not 
converge uniformly on (0, 00), consider (S2n —Sn)(1/n”), where Si, is the nth partial 
sum of the series. 12. Since |a,x*| < |ax| for all 2 € [—1,1] and 5*|a,| converges, 
the given series converges absolutely and uniformly by the Weierstrass M-test. 


16. Set An = = sinkt. By (1) of the proof of Theorem 7.2.6, |An| < 1/|sin $¢J. 


Thus {A,} is caifontely bounded on any closed interval that does not contain an 


integer multiple of 27. The conclusion now follows by the Abel partial summation 


formula. 18. Suppose |Fo(x)| < M for all x € [0,1]. Show that |Fn(x)| < M— 
for all a € [0,1], n € N. Now use the Weierstrass M-test. , 


Exercises 8.3. page 359 


ee 0 =0,1 
1. Show that }> a(1—a2)* = 4” eavease epi by Corollary 8.3.2 the conver- 
k=0 1, O<a<il. 
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gence cannot be uniform on [0,1]. 4. Since f is uniformly continuous on R, given 
€ > 0, there exists a 6 > 0 such that |f(x) — f(y)| < « for all z,yER, |u—y| <0. 
Choose n, € N such that 1/n, < 6. Then for all n > no, | f(x) — fn(x)| < € for all 
xéR. 6. Let € > 0 be given. Since {f,} converges uniformly on D, there exists 
no € N such that | fn(x) — fm(x)| < € for all e € D, n,m > no. Use continuity of 
the functions and the fact that D is dense in FE to prove that |fn(y) — fm(y)| < € 


for ally € E,n,m > no. 9. Note, (1+ 2)” = [a+ 2)*]". For x > 0, as in 


Example 3.3.5, the sequence (1 + zy" is an increasing sequence converging to e”. 
Set gn(x) = e* — fn(x) and apply Dini’s theorem on [a, b] provided a > 0. This has to 
be modified ifa <0. 11. (a) We first note that |(Ty)(2)| < |lgllu [7 dt = x||yllu- 
It now follows that |T(T'y)(x)| < 427||yl|u for all x € [0, 1]. 


Exercises 8.4. page 362 


1. By the Weierstrass M-test and the hypothesis on {ax}, the series }7 agx* con- 
verges uniformly on [0,1]. Now apply Corollary 8.4.2. 4. Since f € R[0, 1], f is 
bounded on 0, 1], i-e., | f(x)| < M for all x € [0,1]. Now apply the bounded conver- 
gence theorem to gn(x) = «” f(a) which converges pointwise to g(x) =0,0< 2a <1, 
and f(1) whenz=1. 6. We first note that 


ice \dar — f |< fue" (0)|ae. 


Now use the fact that 2” > 0 Poke on [0,c] for any c,0 < c < 1, and that 
{ | f(x") — f(0)|dx < M(1—c) for some constant M. 
7. For each k € N the function 2~*I(# — rx) is Riemann integrable on [0,1] with 


1 
J 2-*I(a — rp) = 27~"(1 — rx). By the Weierstrass M-test the series converges uni- 


formly on [0,1]. Thus f € R[0,1] with fia a 2-*(1—rx). 9. By Theorem 
k=1 
6.2.1, fng € Ria, b] for all n € N. Show “that {fng} converges uniformly to fg on 


la, b], and apply Theorem 8.4.1. 10. Since | fn(«)| < g(a) for all x € [0,co), nEN, 
the same is true for |f(x)|. By Exercise 5, Section 6.4, it now follows that the im- 


proper integrals of f,,n € N, and f on [0,00) converge. Since fg < oo, show 
0 


co 
that given € > 0, there exists c € R,c > 0, so that Ig < +e. Now show that 


fr- fa 


to finish the pioah 11. (b) "To show that (C[a, 6], || ||1) is not complete it suffices 
to find a sequence {fn} of continuous functions that converges in the norm || ||1 to 
a Riemann integrable function f that is not continuous. 


< j |f —fn| +2 i g. Use the uniform convergence of {f,} to f on [0, ¢] 


Exercises 8.5. page 369 
2. By the fundamental theorem of calculus, fn(x) = fn(vo) + J f,,(t)dt for all 


€ [a,b]. If {f,} converges uniformly to g on [a,b], use Dhewreas. 6.3.4 and 8.4.1 
to prove that {fn} converges uniformly to a function f on [a,b] with f’(x) = g(x) 
for all x € [a,b]. 4. Let x € (a,b) be arbitrary, and choose c,d such that a <c< 
x <d<_b. Now apply Theorem 8.5.1 to the sequence {f,} on [c,d], to obtain that 
f is differentiable at x with f’(x) = lim f(z). 6. (a) Use the comparison test 
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to show that the given series converges for all « > 0. Let S(z) = > (1+ ka)~? 
h=1 


n 


and S,(x) = >> (1+kx)~?. Then $/,(x) = —2 53 k(1+ka)~%. Use the Weierstrass 
k=1 


M-test and the comparison test to show that the sequences {S;,(x)} and {S’,(x)} 
converge uniformly on [a, oo) for every a > 0. Thus by Theorem 8.5.1 
S'(z) = lim S)(2) = —2 33 k(1 + ka)? 
for all 2 € [a, 00). Since this holds for every a > 0, the results holds for all x € (0,00). 
(c) By the root test the given series converges for all x, |x| < 1. Let S(x) = 772, 2" 
and S;,(z) = {%_) v*. Then S),(z) = 97-9 (k + 1)x*. Again by the root test, the 
series )772)(k + 1)x* converges pointwise for all x, |z| < 1, and uniformly for all 
x, |x| < a for any a, 0 <a <1. Hence by Theorem 8.5.1 
S'(@) =" lim: 84 (@) = 357, (b+ Le 

noo 
for all x, || < a. Since this holds for every a, 0 < a < 1, the result holds for all 
x, |e| <1. 


Exercises 8.6. page 377 

2. Let P = {o,%1,...,2n} be a partition of [a,a + p]. Set yj = x; — a. Then 

P* = {Yyo, Y1,+-5Yn} is a partition of [0,p]. If t € [x;-1,2,], then t = s+ p for 

some s € [y;-1, yj]. Since f is periodic of period p, f(t) = f(s +p) = f(s). There- 

fore, sup{ f(t) : ¢ € [wj;-1,2,;]} = sup{f(s) : s € [yj;-1, yj]}, and as a consequence 

Uu(P, f) =U(P*, f). From this it now follows that LF = {ek The proof for the 

lower integral is similar. Thus f € R[0,p] if and only if f € R{a,a+t pl. 

4. (a) cn =4(n+1). 6. Set An(5) = sup{Qn(x) : x € [—4, 6]}. Then 0 < 61 < d2 

implies An(61) < An(62). Suppose lim An(61) < co for some 6; > 0. Then there 
nm—>oo 

exists a finite constant C and no € N such that An(6) < C for alln > no, 0< 6 < 61. 

Use this fact to obtain a contradiction to the hypothesis that {Q, } is an approximate 

identity. 


Exercises 8.7. page 396 


1. (b) R=2. (d)R=e. (f) R=2. 2. (b) By the root test the series 
converges absolutely for all «,-2 < a < 2/5, and diverges for all other x € R. 


3. (a) o/(l—a)*. 8. (a) 5 = = = ¥ (ake, Jol <1. Use the 


x 


previous exercise and the fact that arctangy = f[(1+ t?)~‘dt to find the Taylor 


0 
series expansion of arctanz atc =0. (c) Use Theorem 7.2.4. 10. Let P(x) = 
a’ + 32? — 22 +5 and use Taylor’s theorem with ec = 1. 12. (b) By Example 


8.7.20(c), na = In(1+(«#-1)) = > & las (a—1)*, which converges for all x, 0 < 

x <2.  (d) By computation, po (x) = $-3---(k-4)- a) (+3), Therefore 

the Taylor series expansion of (1— a)~2 is given by 14 sr ik ae = 3) z*, For 
ee pager: (n+ 4) 


—1 < « < 0, use Theorem 8.7.16 to show that |Rn(x)| < ja|"t*. 


(n+1)! 
oo 1.3... 
Use convergence of the series >> (n+ 3) 


2 |g |n tt ae] < 1, to conclude that 
k=1 (n + 1)! 
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lim Rp(x) = 0, -1 < « < 0.10 < a < 1, use Corollary 8.7.19 to show that 


n—-oco 


1-3---(n +4) x z—C\" 
|Rn(x)| < zm (i — 23/2 (; =<) 


for some ¢,0 < ¢ < x. Now use the method of Example 8.7.20(c) to show that 
lim R,(x) = 0 for all z, 0 < x < 1. Thus the series converges to (1 — a)72 for all 
n—-oo 


£ 1 
Nee A: f) Use the fact that arcsinx = | ——— dt, |a2| < 1. h) For p real, 
el<L ©) [ ptt inl <1. (h) For p 
@= 1) <2 


(l+2)? = l+pe+? ae + P@~ Ve ~?) .8 +--+. If p is a positive integer, 


then the expansion is finite. 


Exercises 8.8. page 402 
1. (a) 1(3) =F($41) = 41P(4) = 47. 2. Make the change of variable t = — Ins. 


a eae 
3. (a) fo era S12) = 2 /r, 53 (a) J (sine)? de = as a) 


Chapter 9 


Exercises 9.1. page 417 


1 1 1 1 
1. f df= f1=2and f ¢3= f x? = 2/3. Therefore c; = 
“1 31 


-1 -1 


4 sin 7a dx = 0 and 


Lose 


1 
co = 2 f xsinradx = 3/n. Thus by Theorem 9.1.4, S2(x) = (3x)/m gives the best 


approximation in the mean to sinmaz on [-1,1]. 3. (a) a1 = 1/2, a2 = 1, a3 = 
-1/6.  (b) S2(x) = 2 + 3 (n? — 12)(a7 — 2 + 2). 
( 


1)"*1. Therefore 


“us 
5. (c) bn = ad = —2cosnn = 


u~2 ie ae sinkx. 6. (c) x Tee > : cos(2k + 1)x 
ka. ania 2 © =o (2h +1)? , 
12. (a) As in the proof of Theorem 7.4.3, for \ € R, 0 < ||x — Ay||? = |Ix|l? 


2A(x, y) + A? |ly||?. If y #0, take A = (x,y) /|ly||? to derive the inequality. 


Exercises 9.2. page 422 


4. (a) For the orthogonal system {sinna}72, on [0,7], [> sin? na dx = 47. There- 


fore b, = 2 i f(x) sin na dx. Thus Parseval’s equality for the orthogonal system 
co wT 2 2 

{sinnz} becomes >> b;, = 2 f f?(x) dz. (b) (i) = (ii) = 5. Use Parse- 
n=1 0 


val’s equality and the fact that fg = $[(f+ 9)? —f?—g’]. 6. Any function that is 
identically zero except at a finite number of points will satisfy he f(x)on(a) dx = 0. 
Exercises 9.3. page 431 


1. (a) If f is even on [—7, 7], then f(x) sinna is odd and f(x) cosnz is even. Thus 


by = 0 for all 1,2) oand a,,= 2 f f(@)\cos nade, n= 0,1; 2.24 
0 


3G 


8. (a) f(x) ~ ty fice cy) setae ‘ > nan _sin(2k + 1a. 
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(c) || ee 5 : cos(2k+1)x. (e) lt+a~r1+2 3 at 
2 © f= (2k + 1)? : kari , 
Bt = eh a GS ees 
or 2k +1 S egen 2 wo 2k+1 means 
PD, - [(—1)” — cos nz] sinne. 
6. (c) Since he is even, the Fourier series of he is the cosine series of h. Therefore 
a /2 wT 
c 2c TC 
= d dz = d 
ao = — J adx+ ae x) dx 7? an 
Qc 71? 26.8 2c 
r= — dx + — ~ d= 2cos 2% 4+ (—1)"t* — 1]. 
a = feenene x + pe x) cosnx dx a [2 cos 2% + (—1) | 
co 1 (_1)\8 
Thus he(#)  ~ ae Z oS ia cos 2kx. 7 (b) f(x) ~ ee 
4 T p=1 k2 T 


4 co 

7, G1 
Since f” € R[-7,7], it is bounded on [—7,7]; ie., |f’(x)| < M. Therefore 
|be| < 2M /k?. Similarly for a,. Thus by the Weierstrass M-test, the Fourier se- 
ries of f converges uniformly on [—7, 7]. 


cos2kx. 8. By integration by parts, by = -, f f" (2) sin ke da. 
Tv —w 


Exercises 9.4. page 442 


2. 90° 3. To show that {sinnx}?2, is complete on [0,7] it suffices to show that 


Parseval’s equality holds for every f € R[0, 7]; i-e., 5° b2 = Z J f? (x) dx. To accom- 
n=1 T oO 


plish this, let f. denote the odd extension of f to [—7,7]. Since f, is odd, an = 0 
for all n = 0,1,2..., and bh = 2 f(x)sinnz dx. Since the orthogonal system 


{1,cosna, sinna}9, is complete on [—7, 7], S> b? = Z { Je) aa A ff? ae) da 
n=1 TH a) 


6. Let Sn(t) = $a0 = D> agcoskt + be sinkt. If x € [—7,7], then 
k=1 


SF sae f sult at] < f 1 - Salsa 


Thus by Exercise 5(a) and Theorem 9.4.7, lim f S,(¢)dt = f f(t)dt, with 
noo S 


—T 


the convergence being uniform on [—7,7]. But f Sn(t)dt = 4ao(a@ + 7m) + 


—T 


i b 
Ss (4: sin ka 7 (cos ka — cos kn), from which the result follows. 10. Use 
k=1 


Lemma 9.4.8 and the Weierstrass approximation theorem. 


Exercises 9.5. page 453 
1 1 
) er es a4 b) =- 
Tee (a)5- (b)5 


(b) On [—7, 7], the series converges to e 
of e!?*! on all of R. 


Tv 


6. (a) (e*7 — 1) , 2a > ((-1)"e*" — 1) 


4” atm TW k= a2 + k2 
jax| 


cos kx. 


, and thus to the 27-periodic extension 
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Chapter 10 


Exercises 10.2. page 474 


2. Since U is open and non-empty, there exists « € U and r > O such that 
(a—r,a+r) C U. Thus by Theorem 10.2.4, m(U) > m((a-r,a+r))=2r>0. 3. 
Let Ve = (—e,1+.€). Then V is an open set containing P. Show that m(V.\ P) > 1 
for all e > O and thus m(P) < 2 for every « > 0. Alternately, show that 
m(P° 1 [0,1]) = 1 and use Theorem 10.2.15. 6. First show that there exist dis- 
joint bounded open sets Ui, U2 with Ui > Ky and Uz D Ke. Then m(ki U Ke) = 
m(U,UU2)—m((U1 UU 2) \ (Ki UK2)). But (U1 UU 2)\ (Ki U Ke) = (U1\ K1)U(U2\ Ka). 
Now use Theorem 10.2.9. 


Exercises 10.3. page 480 


1. (b) First show that if U is any open set, then U+z is open and m(U+2z) = m(U). 
Use this and the definition to prove that A*(£+.2) = »*(£). If K is compact and U 
is a bounded open set containing K, show that (U+2)\(K+<2) =(U\K)+a. Use 
this to show that m(K +2) = m(K) and \.(E+2) =.(£). 3. Since Ein E2 C Ei 
and \*(F) = 0, A* (£1 E2) = 0. Thus by Theorem 10.3.5, £1 M E2 is measurable. 
For E, U Ey apply Theorem 10.3.9. 6. If A*(E) < oo, then for each k € N there 
exists an open set Ux with Ux > E such that m(Ug) < A*(E) + ;. Now use the fact 
that EF C(\Un C Ux forallk EN. 8. Set Ex = EN[—k,k], k © N. Then {d.(Ex)} 
is monotone increasing with »,(E,) < A«(£) for all k € N. Let a = im Ax (Ex). 


Suppose a < \x(£). Choose 8 € R such that a < 6 < x(£). By definition there 
exists a compact set K with kK C E such that m(K) > 6. Use this to show that 
there exists kp € N such that ».(Ex) > 8 for all k > ko, which is a contradiction. 


Exercises 10.4. page 488 


2. If EF is bounded, the result follows from the definition of \.(/) and A*(£), and 
Theorem 10.4.5(b) (for a finite union). If FE is unbounded, let E, = EM (—n,n). 
Given € > 0, choose Uy open such that E C U, and A(Un\ E) < ep Let U = Un. 
Show that U\ E Cc U(Un \ En). Now use Theorem 10.3.5 to show that \(U \ E) < e. 
To obtain a closed set F C E satisfying A(F\ F’) < ¢, apply the result for open sets to 
E*, 4. First show that A(£,U £2) = 1; then use Theorem 10.4.1. 6. If FE’ satisfies 
\*(EUT)+\*(E°UT) = A*(T) for every T C R, then E satisfies Theorem 10.4.2 and 
thus is measurable. Conversely, suppose £ is measurable and T C R. If A*(T) = 00, 
the result is true. Assume A*(T’) < co. Let € > 0 be arbitrary. Then there exists an 
open set U > T such that A(U) < A*(T) + €. Since E and U are measurable, EU 
and E° OU are disjoint measurable sets with (EN U)U(E°NU) =U. Furthermore, 
ENUD EQT and E° NU D E* NT. Thus by Theorem 10.3.9 

M(T) < M(ENT) + M4 (E° NT) < MENU) +A(E°NU) = AU) < A*(T) +. 
Since the above holds for every « > 0, we have \X* (ENT) + A* (ES NT) = A*(T). 


Exercises 10.5. page 494 


(0, 1], ifc <0, 

. — JOU, if0<c<1, 

1. {x: f(z) >ch= (0, 2)U (1) ifl<c<Q2, 
(0, +), if2<e. 


5. If c > 0, then {x : L/ole ) > ch = {x : g(x) > O} {x : g(x) < 1/c}. Since g 
is measurable, each of the sets {g(x) > 0} and {g(a) < 1/c} is measurable. Thus 
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their intersection is measurable. The case c < 0 is treated similarly. 7. If f is 
continuous on [a,b], then f~'((s,0o)) is open in [a,b] for every s € R. Thus for 
a fixed s, f~'((s,00)) = UN [a,b] where U is open in R. Since both U and [a,}] 
are measurable, so is f~'((s,00)), i-e., f is measurable. 10. (a) If c > 0, then 
{a: ft(@) > ch} = {a: f(x) > ch, and if c < 0, then {x : ft (x) > c} = E. Since 
each of the sets {f(x) > c} and E are measurable, ft is measurable. (ce) Not in 
general. If FE is a non-measurable set, consider the function that is 1 on & and —1 

on E*. 12. Since both x” and f are measurable, by Theorem 10.5.4 their product 
is measurable. Suppose | f(a)| < M for all x € [0,1], then | f,(x)| < Max” from which 
the result now follows. 14. Since f is differentiable on [a, }], 

f'(a) = lim n[f(@+ 4) — F(a)] 

for all x € [a,b]. For each n € N, gn(x) = n[f(x+ +) — f(2)] is measurable (Justify). 
Thus by Corollary 10.5.10, the function f’ is measurable. 15. First show that given 
e, 0 > 0, there exists a measurable set E C [a,b] and no € N such that A([a, b]\E) < € 
and | fn(«) — f(a)| < 6 for all « € E and n > no. To accomplish this, for each k € N 
consider 

Ay = {x :|fn(x) — f(x)| < 6 for all n > k}. 

Now show that Jim, (Aj) = 0. Here Ay = [a, b]\\Ax. Complete the proof of Egorov’s 


theorem as follows: By the above, for each k € N, there exists a measurable set Ei, 
and an integer nz such that \(Eg) < €/2* and | f(x) — fn(z)| < 1/k for all c € Ex 
and n > ng. The set FH = (| Ex will have the desired properties. 


Exercises 10.6. page 506 
1. For each n EN, let yn = 35 (m+ (j - 1) B\va.. Then gn is a simple function on 
j=l 


[a, b] with vi pndXr = Sn(f). Furthermore, for each x € [a,b], 0 < f(x) — yn(x) < 
B/n. Therefore lim y,(x) = f(x) for all x € [a,b]. Now apply the bounded conver- 
n—-oo 


gence theorem. 3. Suppose |f| <M. Then |f, fdd| < f,|f|dA < MA(A), which 
proves the result. 5.By Theorem 10.6.10(b), f fdA=ffdst+ f fddv\> f fdr. 
F E F\E E 
7. For each n EN, let E, = {x : f(x) > +}. Then UE, = {x : f(x) > O}. Use 
the previous exercise to show A(E;,) = 0. Now use Theorem 10.4.5. 12. The func- 
tion y, defined in the solution to Exercise 1 satisfies | f(x) — Yn(x)| < 6/n for 
all « € [a,b]. Thus {y,} converges uniformly to f on [a,b]. 15. (b) Suppose 
first that g = ya where A is a measurable subset of [a,b]. By Exercise 2, Section 
10.4, there exists an open set U D A such that \(U \ A) < €/2. Use the set U to 
show that there exists a finite number of disjoint closed intervals {Tigh y such that 
N 
V =UN_, Jn CU and XU \ V) < €/2. Let h = ¥> xu, Then h is a step function 


on [a,b] and {x : h(x) 4 p(x)} C(U\ V) U(U\ A). If p= 3) ajxXA;, where the A; 


are disjoint measurable subsets of [a, b], approximate each x A, by a step function h; 
which agrees with y4, except on a set of measure less than ¢/n. 


Exercises 10.7. page 516 
2. (a) Assume first that Ai and Az are bounded measurable sets. For each n € N, 
set fn = min{ f,n}. By Theorem 10.7.4(b) 


J fad\=fy, fad0+ fy, fad d. 
A,UA2 
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Since each of the sequences { f ae fn }p1, t = 1,2 are monotone increasing, they con- 
verge either to a finite number, or to oo. In either case, 


J fddy= lim f f,d\= lim ff fadr+ f fad = frat f fa. 
A,UAg WO? ATUAS 
If either Ai or Az is unbounded, ane the ieteeail of f over (Ai U eee [—n, nl], 
and use the above. 4. For fp(x) = « ?, a € (0,1), fn(x) = min{fp(x),n} = 


, teen, 
aa i ie Therefore 
e?, nVP<a<l. 
1 n—1/P oF 1 1 1 
= —P — i -_ 
ee as ae aS na-p)/p it acum 


1 1 p 
l-p |: 


1 N N 
Since (1—p)>0, lim f fndX=1/(1—p). 7.0< “ nX\(L,)< dO f fdr 


n=1 n=-1E. 


n 


7 far.< fra <oo. 9. Justify first why f can be assumed to be non- 
UN 


n=1En 
negative and then use Definition 10.7.1. 10. Let A, = AN [—n,n]. By definition, 
f[,fa= Jim n San f dd. Since f is integrable, given « > 0, there exists n € N such 
that 0 < [far fd\ <e. By Theorem 10.7.4(b), f fdA— f fdA= ff fad. 
A An A\An 
Thus E = A, is ae desired set. 13. Let f, = min{|f|,n}. Then 0 < fn < |f|. 


Since f is integrable, by Lebesgue’s dominated convergence theorem lim f fndA = 
N00 A” 


J \f| dd. Therefore, given € > 0, there exists n € N such that [(|f| — fn) dA < €/2. 
A A 


In particular, if E is ey measurable subset of A, 
[If|ar< f fudd + 36 


But if ME) < 00, fiz fnddA < ACE): Hence choose 6 > 0 so that nd < €/2. 15. For 
n € N set hn(t,x) =n [sin((t + +) f(x) — sin(tf(x))]. Show that |An(t,x)| < 2|f(x)| 
and apply Lebesgue’s dominated convergence theorem. 16. First prove the result 
for the characteristic function of an interval. Then use Exercise 9 above and Exercise 
15 of Section 10.6. 19. Since { f;,} is monotone increasing on A, f(x) = lim fn(x) 


exists, either as a finite number or as oo, for every « € A. By Fatou’s lemma, 
J, f dd < lim J, frdd. On the other hand, since f, < f for alln €N, lim f, fn dA < 
f 4 /4\. Combining the two inequalities proves the result. 21. (a) Use the mono- 
tone convergence theorem. 23. Hint: |f(ax)| > (1/x)|cos1/ax?|— 2a > a7! — 22 on 
each of the intervals ((2n + 1) q)—3 <a <((Qn-— Drs. 

Exercises 10.8. page 526 

1.0<p< 4. 4. Since |f + g|? < 2(|f|? + |g|*), the function f +g € L7(A). 
Assume || f + g|l2 4 0. Then 

If + 91] = f{lft+als s Jl +sllfl + SIF + sila 


which by the Cauchy Seiwati sneqnenned < lf + gllellflle+llf + gllallglle- The result 
follows upon simplification. 7. Use the Cauchy-Schwarz inequality. 9. (a) By 
Bessel’s inequality it is the Fourier series of an £((0,7]) function. 13. Let f(x) = 
1/Inz, x € (1,00). Since f”(x) > 0 for all x € (1, oo), f is convex on (1,00) (see 
Miscellaneous Exercise 3, Chapter a): Therefore f(42+4y) < $f(x)+4f(y) for all 
z,y € (1,00). Since n = $(n — 1) + $(n +1) the inequaliyy follows. 
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